-- Logs begin at Fri 2022-07-29 10:58:39 UTC, end at Fri 2022-07-29 12:10:55 UTC. -- Jul 29 11:32:02.958176 dv-cinder-837542-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 29 11:32:02.966233 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 11:32:02 2022] *** Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: nodename: dv-cinder-837542-7-iscsi Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: machine: x86_64 Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: clock source: unix Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: pcre jit disabled Jul 29 11:32:02.968281 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: detected number of CPU cores: 4 Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: current working directory: / Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: detected binary path: /usr/bin/uwsgi-core Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: your processes number limit is 47680 Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: your memory page size is 4096 bytes Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: detected max file descriptor number: 2048 Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: lock engine: pthread robust mutexes Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: thunder lock: enabled Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 29 11:32:02.968868 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 11:32:03.010116 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: Python main interpreter initialized at 0x55a1a33d49c0 Jul 29 11:32:03.010116 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: python threads support enabled Jul 29 11:32:03.010116 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: your server socket listen backlog is limited to 100 connections Jul 29 11:32:03.010116 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: your mercy for graceful operations on workers is 90 seconds Jul 29 11:32:03.010502 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 11:32:03.010600 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: *** Operational MODE: preforking *** Jul 29 11:32:03.010925 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: *** uWSGI is running in multiple interpreter mode *** Jul 29 11:32:03.010925 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: spawned uWSGI master process (pid: 86817) Jul 29 11:32:03.011140 dv-cinder-837542-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 29 11:32:03.014288 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: spawned uWSGI worker 1 (pid: 86830, cores: 1) Jul 29 11:32:03.014288 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: spawned uWSGI worker 2 (pid: 86831, cores: 1) Jul 29 11:32:03.014288 dv-cinder-837542-7-iscsi devstack@keystone.service[86817]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 11:32:08.552398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:32:08.552398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: from cryptography.utils import int_from_bytes Jul 29 11:32:08.553146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:32:08.553146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 29 11:32:08.553616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:32:08.553616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: from cryptography.utils import int_from_bytes Jul 29 11:32:08.553748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:32:08.553748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 29 11:32:08.602179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:32:08.602334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:32:08.602407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:32:08.602532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:32:08.603164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] command line args: [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:32:08.603250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] command line args: [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:32:08.603369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:32:08.603510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:32:08.603625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ================================================================================ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:32:08.603721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ================================================================================ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:32:08.603790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] admin_token = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.603936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_dir = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_dir = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] config_source = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_source = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] debug = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] debug = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.604844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.605882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_config_append = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_config_append = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_dir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_dir = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.606988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.607961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.608853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.609989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.610933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] publish_errors = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] publish_errors = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.611940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] standard_threads = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] standard_threads = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.612954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_journal = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_journal = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_json = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_json = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_stderr = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_stderr = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_syslog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] use_syslog = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.613970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:32:08.614149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.614973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.615947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.616920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.617996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.618072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.618142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.618873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.618973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.619955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.620953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.621926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.622883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.623859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.624942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.625927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.626968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.627945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.628846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.629843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.630961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.631965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.632937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.633961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.634917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635004 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.635991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.636946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.637912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.638850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.639995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.external = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.external = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.640989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.password = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.token = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.password = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] auth.token = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.641967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.642934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.643995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.644946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.645971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.646997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.647979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.648946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.649998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.650997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.651959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.652933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.653911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.654906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.655874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.657963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.658996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.659936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660576 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.660906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.661884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.662993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.663970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.664923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.665010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.665697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.665790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.665961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.666951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.667884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.668992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.669988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.670941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671902 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.671981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.672955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.673950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.674874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.675861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.676836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.677994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.678897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.679966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.680689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.681405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.681546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.681691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.681777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.681940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.682977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683860 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.683939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.684886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.685917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.686997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.687940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.688969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.689946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.690969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.691920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.692951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:32:08.693032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:32:08.693175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:32:08.722216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.722444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.722530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.722670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.722755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.722978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.731513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.731962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.761913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.762143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.762525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.762763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.814559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.814920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.864952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.865188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.865298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.865565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.930678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.931461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.931597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.931754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.931895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.931977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.932827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.955823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.955972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.956968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.957100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.957183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.957312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.968119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.968494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.980746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.980982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.981977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.982110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.982202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.982376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.982595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 11:32:08.999453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:08.999643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:08.999730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 11:32:08.999852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 11:32:08.999988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.000185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.000268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 11:32:09.000387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 11:32:09.000470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.000658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.000751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.000919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.001001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.001175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.001264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.001445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.011721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.011878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.012694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.019465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.019562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.024149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.024265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.024433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.024569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.024839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.024942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.025951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.026952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.027034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.027219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.050218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.050318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.051705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.051790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.051987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.052070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.057144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.057244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.057435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.057521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.057724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.057809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.064314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.064404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.064648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.064747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.068760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.068851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.069049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.069998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.070834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.087144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.087386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.087465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.087741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.091339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.091681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.094496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.094795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.094876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.095148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.099181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.099525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.102365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.102775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.105625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.105925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.106876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.107071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.107155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.107368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.123531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.123817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.123901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.124087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.124184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.124351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.124435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.124661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.131275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.131568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.133073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.133350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.133464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.133646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.136869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.137153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.137278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.137475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.137588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.137768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.137889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.138052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.138173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.138468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.149513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.149870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.149955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.150163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.150246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.150446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.150539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.150730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.150814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.151008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.151092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.151281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.151366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.151568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.167464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.167643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.170436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.170640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.173387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.173606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.175911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.176084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.177493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.177673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.177788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.177959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.178069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.178239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.185219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.185408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.186856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.186996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.189797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.189903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.190895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.198642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.198795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.198927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.199087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.199208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.199369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.206045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.206239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 11:32:09.206324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.206525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.206607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.206811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.206902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.207994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.208918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.209924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 11:32:09.243347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1a33d49c0 pid: 86831 (default app) Jul 29 11:32:09.244227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1a33d49c0 pid: 86830 (default app) Jul 29 11:32:09.247280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8571-465d-4490-a5a6-a680af2b86b9 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:09.247570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8571-465d-4490-a5a6-a680af2b86b9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:09.247847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8571-465d-4490-a5a6-a680af2b86b9 None None] PATH_INFO: `/v3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:09.252120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Fri Jul 29 11:32:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:16.854082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:16.854645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:16.854645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:16.859145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:16.864590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:16.865011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:16.865142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:16.937070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: INFO dbcounter [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] Registered counter for database keystone Jul 29 11:32:16.958836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:32:16.965736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writer thread running {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:32:17.146296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG passlib.handlers.bcrypt [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86831) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 11:32:17.146634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG passlib.handlers.bcrypt [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86831) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 11:32:17.202621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:17.204224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:17.331734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 29 11:32:17.487172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:17.557467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: INFO dbcounter [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] Registered counter for database keystone Jul 29 11:32:17.577050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:32:17.583566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writer thread running {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:32:17.702455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6579be-2593-4a8a-8f63-117c0fefa219 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:17.706914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:17.707550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:17.707829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:17.708107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:17.716981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:17.768713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING keystone.common.rbac_enforcer.enforcer [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 11:32:17.768989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc32b11-7467-4232-be57-de00e7b72361 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:17.780351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Jul 29 11:32:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:32:17.786393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:17.801669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec8066-3216-471d-88d7-b130b1116df5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:17.806255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:17.807522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:17.807803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:17.808075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] PATH_INFO: `/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:17.809594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b9c00e3cb2134915b18b1a5e5538e94a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:17.859927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 11:32:17.860276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58e3d9-946c-4411-aa23-a39bcb884ab2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:17.865161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Fri Jul 29 11:32:17 2022] GET /identity/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:19.878271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63e98-604d-49ef-980e-64720d564c31 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:19.878792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63e98-604d-49ef-980e-64720d564c31 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:19.878877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63e98-604d-49ef-980e-64720d564c31 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:19.882999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:19.889003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:19.889435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:19.889600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:19.910160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:19.911712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:19.920462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 29 11:32:19.942914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd63e98-604d-49ef-980e-64720d564c31 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:19.955873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd63e98-604d-49ef-980e-64720d564c31 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:19.960574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:19.961233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:19.961520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:19.961898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:19.970460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:19.972243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2caaa6-f4e1-4e22-8062-1422e0c18a39 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:19.981981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Jul 29 11:32:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:32:19.987721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:19.997987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043670a3-3b38-4129-9b18-0484aa98e907 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:20.002592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:20.003233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:20.003514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:20.003789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:20.005159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:20.007018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065a0ad-f15d-41fe-876f-bc41879c0a2d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:20.008846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Fri Jul 29 11:32:19 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:22.089913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb586c-91f1-4913-b75c-0e26fcc3e495 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.090426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb586c-91f1-4913-b75c-0e26fcc3e495 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.090515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb586c-91f1-4913-b75c-0e26fcc3e495 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.091781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:22.097262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.097706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.097845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.118291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:22.120129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:22.136807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373632f1-de3a-4902-8158-4552be67ae8c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.137242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373632f1-de3a-4902-8158-4552be67ae8c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.137342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373632f1-de3a-4902-8158-4552be67ae8c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.138717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:22.145452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.145452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.145452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.192081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86830) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 11:32:22.192522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86830) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 11:32:22.216253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:22.239468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:22.239824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.241076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:22.267811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:22.352679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783db29f-3e1c-41ad-b222-ae03a785be1f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:22.357748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:22.379667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.390895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:22.391790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.392224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.392495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.406648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:22.415530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:22.417215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:22.419581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:22.423406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.490353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f52fc-de49-4f63-b0d3-c31994c11a06 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:22.492901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:22.511607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:22.534746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:22.535636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.535923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea044-aa3f-47d3-9476-aa701151a0bf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:22.536208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.576644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:22.577369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.577738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.578016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.578764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:22.579119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:22.580937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:22.595077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:22.600599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.622151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:22.624313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:22.717788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430978-98f8-44e3-8538-6240771b6299 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:22.736103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 11:32:22.742105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.746183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:22.859798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e21c1-893b-4476-a6c7-5a5a24c1df49 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:22.875750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:22.875750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.875750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.875750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.877246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:22.879724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:22.881522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:22.887963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:22.897212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:22.898134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:22.898410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:22.898679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:22.904430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:22.918874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:22.920364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:32:22.943031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:22.943883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:22.944671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:32:22.944671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:32:22.944671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:32:22.944671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:22.944671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:22.950768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:23.014516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dba0-dbf0-49bd-a784-146a63f6a384 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:23.018601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:23.054920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:23.055570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:23.055851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:23.056130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:23.057989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:23.059435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:23.061182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:23.067073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:23.070780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e666-6e47-4227-b464-dcffbd05484e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:23.105045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:23.105822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:23.106018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:23.106297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:23.107002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:23.107308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:23.108697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34c3b-e40d-40ad-b49f-26f2aae1e866 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:23.125847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:23.167510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:23.194013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f5bcd-d7ad-4e73-8836-cbac4be6324f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:23.232985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:23.233992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:23.234277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:23.234548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:23.235353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.domain.id=default, user.id=0086f32849da40e39473b6be830b5501) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:23.235660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:23.237131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693cfc9-b8cb-43b3-a5d3-0f1a59d06e60 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:23.245664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Jul 29 11:32:23 2022] GET /identity/v3/role_assignments?user.id=0086f32849da40e39473b6be830b5501&scope.domain.id=default&role.id=49c473efb0f54f149c348fb507115880 => generated 233 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:25.723089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e009-965c-484a-920c-0fc0645c699c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:25.723089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e009-965c-484a-920c-0fc0645c699c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:25.723089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e009-965c-484a-920c-0fc0645c699c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:25.723089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:25.730260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:25.730679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:25.733456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:25.741529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36301-aa2e-4de4-a2d4-874136d66aa4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:25.741910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36301-aa2e-4de4-a2d4-874136d66aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:25.742436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36301-aa2e-4de4-a2d4-874136d66aa4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:25.744335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 12/23] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:25.750756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:25.751317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:25.751793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:25.773297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:25.774527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:25.802706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:25.803914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:25.999283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 12/24] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:26.017034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:26.054505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.061496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.141813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:26.203613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:26.238935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207551d-1dcd-4fbe-ab18-c2a2937c4fb5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.267665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c05b9a-8336-4475-ad88-58ff6619ee20 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.284488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.285526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.286066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.286541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.298384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:26.300455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3a0b3773-234b-4500-b333-68fc8fe7bfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:32:26.319279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:26.320167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:26.320948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:32:26.320948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:32:26.320948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:32:26.320948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:26.324562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 14/26] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:26.326165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5f734-6c08-4844-90a5-89e1b5d2db40 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.326726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5f734-6c08-4844-90a5-89e1b5d2db40 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.327204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5f734-6c08-4844-90a5-89e1b5d2db40 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.328661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 15/27] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:26.330541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5f734-6c08-4844-90a5-89e1b5d2db40 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.359958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.361156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.362804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.363876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.383485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-aa3d1177-5fc5-422e-9137-567537a5e8e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:26.389875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:26.390710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:26.391460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:26.393938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:26.395861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.396352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.396848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.417227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:26.418803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:26.492757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 14/29] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:26.494844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.552968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:26.560931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5f734-6c08-4844-90a5-89e1b5d2db40 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.610841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:26.675345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfb8f-3d31-4a4e-ae6e-9971a7f16c93 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.714626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.715680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.716198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.716694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.717672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:26.718180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:26.719861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:26.729653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 15/30] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:26.731070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.815687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.816191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.816466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.816792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.817517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:26.817826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:26.819358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:26.831580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:26.832390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:26.847260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8b00-1cc9-4333-9253-6dfea8d356c1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.874562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:26.884495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.886006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.886554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.887029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.887956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:26.889637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:26.947050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfdd49-db3d-4521-9436-83686ce3d4da None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:26.988750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:26.989832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.990338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.990817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:26.992521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:26.994288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a3c1-968b-40fa-8c9d-7e851b101d5e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:26.996570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:26 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:26.998122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429dd01-bb9e-48a6-93c5-927c1453829c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:26.998611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429dd01-bb9e-48a6-93c5-927c1453829c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:26.999084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429dd01-bb9e-48a6-93c5-927c1453829c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.000902 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 18/33] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:27.001942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429dd01-bb9e-48a6-93c5-927c1453829c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.033957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:27.038457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 16/34] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Jul 29 11:32:26 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:27.039905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.133721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429dd01-bb9e-48a6-93c5-927c1453829c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.175716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:27.176404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.176689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.176963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.177709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:27.178477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a033da-4e2b-4f90-ad5a-161ac379704f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.183603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff22ae-41f4-48a5-a446-ec55dbbfa436 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:27.224248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:27.224925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.225214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.225534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.226882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:27.228568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ba1f0-1502-4cef-9af4-5010c8fcbe4d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:27.230468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:27.231478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cd2b-f2a2-4165-8987-ba6a41e56bab None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.231761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cd2b-f2a2-4165-8987-ba6a41e56bab None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.232044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653cd2b-f2a2-4165-8987-ba6a41e56bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.253946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f653cd2b-f2a2-4165-8987-ba6a41e56bab None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:27.255470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f653cd2b-f2a2-4165-8987-ba6a41e56bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:27.316515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:27.334978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 18/36] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:27.340197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab38dde-5575-4915-9fa0-3f0a3bddc114 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.340197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab38dde-5575-4915-9fa0-3f0a3bddc114 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.340197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab38dde-5575-4915-9fa0-3f0a3bddc114 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.340197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 19/37] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:27.340197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab38dde-5575-4915-9fa0-3f0a3bddc114 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.366683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 19/38] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/projects => generated 301 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:27.371110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.371406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.371693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.403233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:27.406318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:27.476308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab38dde-5575-4915-9fa0-3f0a3bddc114 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.488871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 20/39] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:27.490163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.501052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:27.517759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:27.518333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.518767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.519051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] PATH_INFO: `/v3/domains/default/users/0086f32849da40e39473b6be830b5501/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.521312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0086f32849da40e39473b6be830b5501, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:27.523268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:27.544675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1361 bytes} [Fri Jul 29 11:32:27 2022] PUT /identity/v3/domains/default/users/0086f32849da40e39473b6be830b5501/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:27.545550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.619710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:27.628555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8b94-0d6c-4ff5-b447-8d6125adc7be None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.677585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:27.678320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.678680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.679035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.679867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:27.682739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee340184-1e4b-4f22-a4a4-5203dd753cee None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:27.709271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 21/41] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:27.709485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33ec1-0635-40d3-92b9-33ccd9d9bc8b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.709564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858e13-a53e-4327-a27a-bb5327d3c3a1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.709564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858e13-a53e-4327-a27a-bb5327d3c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.709564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858e13-a53e-4327-a27a-bb5327d3c3a1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.709564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 22/42] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:27.711278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.711577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.711859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.733270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:27.734653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:27.758019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:27.758710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:27.759319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:27.760407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:27.760970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:27.763052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:27.780578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 21/43] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:27.824945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:27.830976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:27.856494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:27.979310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2e638-0f95-479b-8fae-7fe10388503d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:27.981734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:28.017652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:28.018365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:28.018652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:28.018929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:28.020115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:28.021613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e686a12-8719-4fd1-a346-3a3583a78cb7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:28.023202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 22/45] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:28.029779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:28.127535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7acf-2460-4088-b74d-22a66d37b925 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:28.161601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:28.162231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:28.162520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:28.162802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:28.163488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:28.164977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb3485-e2ed-4d98-856a-afb1faec89df None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:28.191492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:32:28 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:32:29.637319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3ccd1-937f-4d14-98c5-c570f57ad5fc None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:29.637831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3ccd1-937f-4d14-98c5-c570f57ad5fc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:29.637831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3ccd1-937f-4d14-98c5-c570f57ad5fc None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:29.639321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 23/47] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:29.644236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:29.644620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:29.644926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:29.662858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:29.664051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:29.710388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:29.732375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:29.755276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3ccd1-937f-4d14-98c5-c570f57ad5fc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:29.858920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3ccd1-937f-4d14-98c5-c570f57ad5fc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:29.892906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:29.893524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:29.893814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:29.894092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:29.905367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:29.910408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:29.911320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:29.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 24/49] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:29.918057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.016752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146194ba-efa4-473b-9907-90d3eafec041 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.050299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.050924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.051207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.051483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.052193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:30.052500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.053923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d792-bb1c-49b5-965b-89aaf80e2ff4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.065649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 26/50] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:30.071120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.101943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:30.170699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee29e7-b7f8-4161-840a-fc153032a031 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.204748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6853fd-bce7-499d-b08e-a60f0f4f116d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.205042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6853fd-bce7-499d-b08e-a60f0f4f116d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.205324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6853fd-bce7-499d-b08e-a60f0f4f116d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.205632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.206277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.206560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.206709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 27/51] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:30.206874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.207991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.209478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.211055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 25/52] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:30 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:30.211578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d32a-4698-485b-a533-737219e3095f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.211874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d32a-4698-485b-a533-737219e3095f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.212158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d32a-4698-485b-a533-737219e3095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.216925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.231529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6900d32a-4698-485b-a533-737219e3095f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:30.232718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6900d32a-4698-485b-a533-737219e3095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:30.268286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:30.300295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 28/53] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:30.314308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:30.317443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e7007-1952-4bb0-afad-0090a1ef146c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.323172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d32a-4698-485b-a533-737219e3095f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.352246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.352896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.353186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.353617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.354813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.356265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.357891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 26/54] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:30.363676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.421391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d32a-4698-485b-a533-737219e3095f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.455307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.455951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.456232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.456507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.457677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.459124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.460712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:30.462034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e90d5-1b6c-48a0-8032-8badc2caf50f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.466954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:30.496353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.496976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.497260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.497589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.498384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.domain.id=default, user.id=0086f32849da40e39473b6be830b5501) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:30.498699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.500139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d76b6-9802-4153-9908-3150fd939efe None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.506162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Jul 29 11:32:30 2022] GET /identity/v3/role_assignments?user.id=0086f32849da40e39473b6be830b5501&scope.domain.id=default&role.id=49c473efb0f54f149c348fb507115880 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:30.507456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:30.573653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b521eb-8645-4f5f-9d53-fcc727d335fe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:30.610186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:30.610830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:30.611115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:30.611392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:30.612089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:30.613600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593201a-37bf-4d71-b628-95c421401e6b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:30.642767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Jul 29 11:32:30 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:32:32.629144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719afe-2b87-4b7e-858c-00c54c02eb97 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:32.629655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719afe-2b87-4b7e-858c-00c54c02eb97 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:32.629655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719afe-2b87-4b7e-858c-00c54c02eb97 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:32.630977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:32.636476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:32.636845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:32.637070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:32.655303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:32.656472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:32.720671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:32.744913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db719afe-2b87-4b7e-858c-00c54c02eb97 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:32.776970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:32.845473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db719afe-2b87-4b7e-858c-00c54c02eb97 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:32.877853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:32.878491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:32.878777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:32.879055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:32.880264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:32.881686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c161829-acd8-4249-b02f-3d22c246568b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:32.883269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:32.889106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:32.912636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:32.986507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6cdd3-59e4-4adc-90d4-7448caf55e70 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:33.018768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:33.019389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:33.019676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:33.019979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:33.020657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:33.022138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419e028-a963-4009-afb1-84eac879bef4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:33.047202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:32 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:36.170671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f02df-06e5-4a0e-9eaa-8bd82fdd980e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.171698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f02df-06e5-4a0e-9eaa-8bd82fdd980e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.172178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f02df-06e5-4a0e-9eaa-8bd82fdd980e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.174094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:36.184056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.184518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.184613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.214653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:36.215881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:36.311782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:36.344641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a79c-03b6-44f8-8008-27d53f9e3a67 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.344954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a79c-03b6-44f8-8008-27d53f9e3a67 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.345202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a79c-03b6-44f8-8008-27d53f9e3a67 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.346740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:36.350191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.360740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:36.364433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71a76-6f5a-4bfd-a680-e7a8f9d5160f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.364727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71a76-6f5a-4bfd-a680-e7a8f9d5160f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.365005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71a76-6f5a-4bfd-a680-e7a8f9d5160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.398628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dfa71a76-6f5a-4bfd-a680-e7a8f9d5160f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:36.402754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dfa71a76-6f5a-4bfd-a680-e7a8f9d5160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:36.509179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:36.511528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf89b1-0ec1-4c6c-bc81-275442743118 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.512017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf89b1-0ec1-4c6c-bc81-275442743118 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.512468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf89b1-0ec1-4c6c-bc81-275442743118 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.514207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:36.521535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c45b2c-345b-4a6f-9248-8982ca03e713 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:36.522901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.523194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.523581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.543535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:36.545031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:36.566971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:36.567621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.568064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.568467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.571527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:36.583770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:36.592047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:36.592952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:36.593751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 34/67] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:36.598280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.625933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 34/68] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:36.633438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.679634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:36.718063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7f5c9-63d9-4b0a-9f10-0b1187f538bd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:36.746221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d774a-70bb-456c-ba71-da6eb2c80500 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:36.753659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:36.754310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.754595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.754876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.765471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9b7997c3-fb22-42af-ac3d-894a5ea3618e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:36.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:36.778794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:36.779554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 35/69] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:36.781552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee419e-fd9e-40b3-a0d3-c21ee1ad3694 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.781848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee419e-fd9e-40b3-a0d3-c21ee1ad3694 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.782133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee419e-fd9e-40b3-a0d3-c21ee1ad3694 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.782629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:36.783255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.784735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.784855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 36/70] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:36.784943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.785024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee419e-fd9e-40b3-a0d3-c21ee1ad3694 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.785114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:36.785114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:36.786322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6485d5-e3ea-40d0-97bc-fb648e9cfd62 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:36.796145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:36.797357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cbbe2-178e-4f9f-84b0-bfaeb676dbf5 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.797685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cbbe2-178e-4f9f-84b0-bfaeb676dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.797969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cbbe2-178e-4f9f-84b0-bfaeb676dbf5 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.799170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:36.801696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cbbe2-178e-4f9f-84b0-bfaeb676dbf5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.826065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:36.888396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee419e-fd9e-40b3-a0d3-c21ee1ad3694 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:36.903592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cbbe2-178e-4f9f-84b0-bfaeb676dbf5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:36.914536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:36.922815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:36.923475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.923762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.924045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.934529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:36.936646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:36.937293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.937614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.937896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.938618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:36.938930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-60342a75-03bc-42ec-926f-d871e007bd37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:36.939477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:36.940328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:36.941067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:36.941668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:36.941733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:36.941852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f9ea-a256-4632-a285-05baf2632666 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:36.942399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f9ea-a256-4632-a285-05baf2632666 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:36.942399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f9ea-a256-4632-a285-05baf2632666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:36.950861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:36.951678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:36.960960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fbc2f9ea-a256-4632-a285-05baf2632666 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:36.962162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fbc2f9ea-a256-4632-a285-05baf2632666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:37.029725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:37.030915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.031206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.031483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.041764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.058144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3c95-75dd-4587-9efc-6e42f5cc0aa6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.063286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:37.064477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:37.092970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.093639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.093924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.094203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.095375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.096817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.098689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:36 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.099209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.136517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:37.137702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.189782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.204673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2cca9-4f42-436d-90fe-f548083a1efb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.238567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.239188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.239471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.239752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.240470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:37.240778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.241749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50f7f-2e5b-4196-b639-931a5983a608 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.242192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.250106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.252036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.267953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.277800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.278456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.278785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.279066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.294301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.295861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.297746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.298356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.358230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a974e-8763-4cf7-bfc8-9c5e878e9f9b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.391612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.392255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.392538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.392821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.397477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02305-8c8c-42a7-939d-d32676d41ebb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.403379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:37.405304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:37.408771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:37.409658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:37.415559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.432990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.433633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.433923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.434199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.484911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.500193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.501933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.513119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f13e6-6ec6-4e37-a468-20efdf92ca6e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.545846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.546429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.546717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.546995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.548159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.549646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.551246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.552008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.607521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 41/82] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:37.607521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.613641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.651118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040aed-035f-43f5-a682-22be65aa258a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.684311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.684947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.685232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.685541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.686720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.688171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.689795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.690563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.703388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.705587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed710-bbac-4d6a-9815-33ce6561c68a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.739128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.739750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.740032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.740309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.790607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1354d-5a6f-4669-871f-23366a9f3626 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.807874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.809278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.816754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.824518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.825133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.825412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.825715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.826420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:37.826746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.828107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:37.836636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 43/84] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:37.837301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.907555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:37.913834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 42/85] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:37.913834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:37.939161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8eb8-e12c-45ad-9615-621759f40ce0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:37.972557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:37.973174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:37.973483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:37.973766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:37.974498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:37.975888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.002779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 44/86] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:37 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:38.002779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.017800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370311e-3144-4331-8066-a73c09c1f4dd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.022775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.054430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007543ba-3423-4518-b885-aa221113a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.055103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007543ba-3423-4518-b885-aa221113a270 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.055391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007543ba-3423-4518-b885-aa221113a270 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.055671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007543ba-3423-4518-b885-aa221113a270 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.057663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007543ba-3423-4518-b885-aa221113a270 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.059224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007543ba-3423-4518-b885-aa221113a270 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.061171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 43/87] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:37 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:38.061895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007543ba-3423-4518-b885-aa221113a270 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.137485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523939d-87ab-4ebf-8d0d-6228790c8911 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.166577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.178770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007543ba-3423-4518-b885-aa221113a270 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.183170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.183809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.184098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.184379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.222590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.223245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.223536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.223818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.224995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.226475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.228140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:38.229179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.276287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.277894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.288151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.358447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d373f7-abc8-412f-bc47-416ba373cecf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.396031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.396786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.397073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.397352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.398658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.400233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.402215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:38.402994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.407739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 45/90] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:38.408911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.439125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.514399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06ab28-63e1-4cee-899a-e05732409ffa None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.518553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a8b7-e0ce-4757-bc00-4c96d8695718 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.526203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.552342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.553244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.553751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.554191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.555120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=0086f32849da40e39473b6be830b5501) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:38.555576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.557831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.558145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.558772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.559053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.559323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.567548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/role_assignments?user.id=0086f32849da40e39473b6be830b5501&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:38.573227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.634888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.636764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.676623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:38.800615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 46/92] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:38.801408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.824134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e156a-a3ca-41c5-8682-1d20ee560b68 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:38.905448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:38.906031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:38.906314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:38.906590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:38.907921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:38.909379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:38.912775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 47/93] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:38.917673 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:38.941871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806f3-ae40-4e64-ab12-60c18599e0eb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:39.001772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:39.008858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:39.009829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:39.010103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:39.010260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:39.010746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:39.011651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:39.011969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:39.013679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:39.033556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=1bee8395f89b42498b722eee5ee49356 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:39.034477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:39.127092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fc51-d8cf-4f62-aa70-a9aa490ab99a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:39.165029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:39.165625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:39.165908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:39.166767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] PATH_INFO: `/v3/projects/052d476a4a63489fa6de1b600a77e9fd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:39.168415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=052d476a4a63489fa6de1b600a77e9fd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:39.169914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:39.171674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 48/95] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:38 2022] GET /identity/v3/projects/052d476a4a63489fa6de1b600a77e9fd => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:39.183540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:39.271157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b3f-1825-4b10-913b-c811f35c27cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:39.311078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:39.311698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:39.311989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:39.312271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:39.313080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:39.313393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:39.314986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b8feb-c639-49b4-ac65-e5ab4d4f857e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:39.323170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:39 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:39.361551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3c77e-7dbc-43c9-a45f-b185543db2a5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:39.374203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:39.400843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:39.401616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:39.401909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:39.402190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:39.403001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=052d476a4a63489fa6de1b600a77e9fd, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:39.403322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:39.404793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e546053-6114-49ef-b850-5ab38fa6530b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:39.411141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:39 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=052d476a4a63489fa6de1b600a77e9fd&role.id=1bee8395f89b42498b722eee5ee49356 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:40.504665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a062f-4a9a-46f7-bf87-c8152e3ebc9d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:40.505145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a062f-4a9a-46f7-bf87-c8152e3ebc9d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:40.505145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a062f-4a9a-46f7-bf87-c8152e3ebc9d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:40.506510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:40.512055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b117ab-7dd0-4803-8c26-4a6d5543735b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:40.512445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b117ab-7dd0-4803-8c26-4a6d5543735b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:40.512621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b117ab-7dd0-4803-8c26-4a6d5543735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:40.550437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-40b117ab-7dd0-4803-8c26-4a6d5543735b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:40.551644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-40b117ab-7dd0-4803-8c26-4a6d5543735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:40.639050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 50/99] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:40.673212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a062f-4a9a-46f7-bf87-c8152e3ebc9d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:40.743840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:40.788738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02f8-28bf-4003-9494-cff92cf97764 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:40.789336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02f8-28bf-4003-9494-cff92cf97764 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:40.789983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02f8-28bf-4003-9494-cff92cf97764 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:40.795996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 51/100] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:40.797772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:40.798389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:40.798863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:40.809642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a062f-4a9a-46f7-bf87-c8152e3ebc9d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:40.846644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:40.848174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:40.849127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:40.849943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:40.850233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:40.850510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:40.851755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:40.853305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:40.855684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 50/101] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:40.864055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:40.986646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:41.027992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:41.074094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff5bb-72d2-440a-af48-ac57bcdd96c6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:41.101217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:41.125651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:41.151654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:41.152681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.152969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.153249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.160934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:41.162432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:41.230472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 51/103] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:32:40 2022] POST /identity/v3/projects => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:41.276937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea8b10-35d1-4623-aab0-a5f3d8521cdd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:41.340572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:41.341157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.341467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.341749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.361757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:41.367114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:41.368144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:41.369066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:41.376817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 53/104] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:41.378605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:41.521404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b501d4-12e7-4c07-b9bf-c619c053d63d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:41.558304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:41.559025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.559314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.559592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.560333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:41.560640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:41.562083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae19f54-a9aa-49f3-aba9-38bd8bc8d94c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:41.571573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 52/105] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:41.578047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:41.635842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d1a0-33ff-4849-9942-8ff58a9c1e4b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.636460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d1a0-33ff-4849-9942-8ff58a9c1e4b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.636941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d1a0-33ff-4849-9942-8ff58a9c1e4b None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.638926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 53/106] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:41.645748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.646319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.646804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.668820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:41.670945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:41.711240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:41.758362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:41.771603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:41.786336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d4d7-1f96-49a3-bdf9-a903dd984ceb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:41.797563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:41.863644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:41.864397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.864839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.865254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] PATH_INFO: `/v3/users/2c0d716ca1e440078473e7a5edb62e71` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.892704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] RBAC: Authorizing `identity:get_user(user_id=2c0d716ca1e440078473e7a5edb62e71)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:41.894429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:41.896853 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 54/108] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/users/2c0d716ca1e440078473e7a5edb62e71 => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:41.902903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:41.916441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a443aa-d35e-44c9-8bb4-4f3ea5def34f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:41.961445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:41.962473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.962988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.964014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.978327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b8afc11f-b67b-44f0-bcaf-ab30069d08ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:41.986095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:41.987013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:41.987794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:41.990723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 55/109] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:41.992689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5556-a683-4f2a-a5f2-feb9004b51f3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:41.993126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5556-a683-4f2a-a5f2-feb9004b51f3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:41.997509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5556-a683-4f2a-a5f2-feb9004b51f3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:41.998800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 56/110] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:42.000701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd5556-a683-4f2a-a5f2-feb9004b51f3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.045815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.087152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5117d9b-6eb5-4811-963a-9c3ba7115309 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.158034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd5556-a683-4f2a-a5f2-feb9004b51f3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.179318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.182988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.184968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.190320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.225687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.227723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.228397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.230232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.231175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:42.231917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.234529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130537-c6fb-411f-b924-f9a6d6d80e83 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.238427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.257620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 57/111] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:42.257620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.257620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.257620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.289442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:42.290632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:42.315528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.317033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.410033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 58/112] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:42.410632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.451535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.486953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 55/113] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:42.487813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.556285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.556504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c29c5-4837-41cd-bda4-61fae114107e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.591934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.592614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.592920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.593177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.594383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.595850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.597491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 59/114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:42.598258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.613345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52ce2-ce90-41c8-8356-66b09529debf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.650051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.650869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.651161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.651453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.661887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d5b8cc5e-3ea6-45a3-a514-ce5a35f0112a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:42.666869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:42.667877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 56/115] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:42.673386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232d4c-e541-4ed3-a319-0c9827472ad2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232d4c-e541-4ed3-a319-0c9827472ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232d4c-e541-4ed3-a319-0c9827472ad2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 57/116] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c6f7-ed3f-4eb6-9569-12cb27733aa2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c6f7-ed3f-4eb6-9569-12cb27733aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c6f7-ed3f-4eb6-9569-12cb27733aa2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.674083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 58/117] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:42.674752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c6f7-ed3f-4eb6-9569-12cb27733aa2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.702549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.716817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e06a4-299d-48c6-9da3-c0247856c470 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.753960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.755162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.755623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.756042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.757944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.760835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.763090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 60/118] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:42.764070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.786748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c6f7-ed3f-4eb6-9569-12cb27733aa2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.803017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:42.832232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.832891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.833177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.833487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.834661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.836380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8146eb-708f-46af-9e4e-780d8728fc1c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.839320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 59/119] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:42.840371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.840663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.840944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.859374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:42.860566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:42.879833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a18a5-daa1-421a-a75f-02c63364ab1f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:42.918322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:42.918866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.919149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.919423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.920136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:42.920479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:42.921917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9a21-8f0e-45d9-9fe4-fe54d31fac2c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:42.935409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 61/120] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:42.935409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:42.935409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:42.935409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:42.941502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 60/121] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:42.942338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:42.952115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:42.953255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:42.967514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.028013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 62/122] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:43.028879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.073152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a12e-5579-4072-b1a1-fb3b74f7ad70 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.085021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.113898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.114528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.115025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.115127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.115861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=2c0d716ca1e440078473e7a5edb62e71) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:43.116175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.117630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.123358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 61/123] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:42 2022] GET /identity/v3/role_assignments?user.id=2c0d716ca1e440078473e7a5edb62e71&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:43.123963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.146918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44fc76-a839-447b-af77-a31f0d66bd48 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.200006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.201116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.201682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.202148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/0086f32849da40e39473b6be830b5501/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.204741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, user_id=0086f32849da40e39473b6be830b5501, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.206607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.226740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 63/124] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:43 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/0086f32849da40e39473b6be830b5501/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:43.227896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.242434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.304887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbba-a8d6-4225-b90a-dbafcf322893 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.362037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9adcd4-6401-4a7d-b25a-b016029ae198 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.404654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.405615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.406064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.406631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.419426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:43.424941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:43.426059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:43.427001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:43.429137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 64/125] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:43.433443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.433443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.433443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.433443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.434862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.438312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.440421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.441866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 62/126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:43.450431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.514045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.526889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.594901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ac3-8a7b-463c-a8fe-fd6857f62d86 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.615485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a679c5a-d8bc-4b8e-8ee0-9955ba6dd519 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.655144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.655912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.656294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.656580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.657803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.659277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.661252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 63/127] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:43.661834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.662810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.663478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.663762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.664040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.686853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:43.692225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:43.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 65/128] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:43.694229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.772155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0050b0-73ec-4ef6-930a-720bb1fd6654 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.784293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.821376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.822059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.822872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.823168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.824022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:43.824334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.825891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.841746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:43.842606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:43.866247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4980dc-60b0-4c8b-8805-858720e741b9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:43.897867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:43.910905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:43.912742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:43.914201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:43.915232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/02c848f5b953440fb481cbbd44edd421/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:43.918924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, user_id=02c848f5b953440fb481cbbd44edd421, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:43.920631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:43.952664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:43 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/02c848f5b953440fb481cbbd44edd421/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:43.953214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.091454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb489-b4a7-4664-b84e-a1f429c7ed6e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.127927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adde7-1590-43c9-b61e-95d4001bc499 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.169830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.170865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.171398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.171873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.173316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.175158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1316817-f0bf-4dd0-9e1d-e8de3a59dc5b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.177150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 67/131] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.179306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307045b-e2c7-4d00-ac6c-b0d7fe6c4e9d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.179879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307045b-e2c7-4d00-ac6c-b0d7fe6c4e9d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.180360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307045b-e2c7-4d00-ac6c-b0d7fe6c4e9d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.186356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 68/132] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:44.187628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307045b-e2c7-4d00-ac6c-b0d7fe6c4e9d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.207410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.207800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.208089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.208374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.209094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:44.209461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.210828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc45ce-238d-49c0-9cf7-c4a9edc8f983 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.222387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 65/133] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.223599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.223892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.224173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.250062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:44.251055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:44.284483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:44.285773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:44.325374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307045b-e2c7-4d00-ac6c-b0d7fe6c4e9d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.334022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 66/134] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:44.334022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.401207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.401908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.402189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.402464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.411982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.413504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.415547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:44 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.416532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.532892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cd635-d837-4b7b-bcd9-8f5cfd02c1ff None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.591333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f2c5-da85-459a-a9ce-e53aab630451 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.596515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.597206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.597518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.600731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.604184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.604418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.606483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 67/136] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:44 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.607397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.640348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:44.660209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.661205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.661946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.663469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.664876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.667973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.675161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 70/137] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.676221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.677161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:44.779460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2e895-5018-45d7-bf79-a99d9436c22c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.847362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.847960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.848241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.848519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/02c848f5b953440fb481cbbd44edd421/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.852620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, user_id=02c848f5b953440fb481cbbd44edd421, role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.854481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.871771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738b69-8f46-41ca-a9ab-362aed2b8cfa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:44.899949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 68/138] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:44 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/02c848f5b953440fb481cbbd44edd421/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:44.900976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:44.922885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:44.923566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:44.923853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:44.924129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] PATH_INFO: `/v3/projects/052d476a4a63489fa6de1b600a77e9fd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:44.929388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] RBAC: Authorizing `identity:get_project(project_id=052d476a4a63489fa6de1b600a77e9fd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:44.930910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:44.935181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 71/139] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:44 2022] GET /identity/v3/projects/052d476a4a63489fa6de1b600a77e9fd => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:44.941489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:45.079493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:45.105917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:45.126797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0fbb-8748-4ba8-9946-6a06c825ae5a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:45.190053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441450-230c-4439-9c89-8624023eaf2d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:45.220693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:45.221711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.222004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.222288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.223006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:45.224979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627a9e2-4dc1-4447-985b-694a99557448 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:45.251276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:45.252075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.252384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.252727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] PATH_INFO: `/v3/projects/052d476a4a63489fa6de1b600a77e9fd/users/02c848f5b953440fb481cbbd44edd421/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.257218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 69/140] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:44 2022] POST /identity/v3/users => generated 283 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:45.262639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=052d476a4a63489fa6de1b600a77e9fd, user_id=02c848f5b953440fb481cbbd44edd421, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:45.264156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46a3f-98fd-438c-8cb4-817b57310d36 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:45.290992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 72/141] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:44 2022] PUT /identity/v3/projects/052d476a4a63489fa6de1b600a77e9fd/users/02c848f5b953440fb481cbbd44edd421/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:32:45.688194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3511-ea10-4905-9a11-4c9fba3f52a3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.688714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3511-ea10-4905-9a11-4c9fba3f52a3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.688798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3511-ea10-4905-9a11-4c9fba3f52a3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.690337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 70/142] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:45.698579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.699053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.699254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.719888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:45.721079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:45.799196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6efab3-c033-4f09-834c-2b9325667213 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.799518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6efab3-c033-4f09-834c-2b9325667213 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.799749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6efab3-c033-4f09-834c-2b9325667213 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.801249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 71/143] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:45.810220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:45.810501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:45.810780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:45.837068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 73/144] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:45.848294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:45.849501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:45.894787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:45.988447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 72/145] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:45.993315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:46.014086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.109808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:46.127377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29458-707d-4a25-a8e0-7e054a5e7cf5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.129407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9420-3056-4634-a3b4-43c68c6350f6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.169006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.169800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.170095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.170373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.181117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:46.189262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:46.190309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:46.191174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 73/146] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:46.197966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.258257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.258856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.259141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.259423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.292290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:46.305537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:46.306538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:46.307873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:46.314379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.361977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83ed80-fb25-40e0-8d02-6312225f9ad1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.418382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.419037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.419324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.419605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.420341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:46.420648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:46.422153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:46.431382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 74/148] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:46.432429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:46.437848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.575996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18989-f1ea-4e74-bb1f-126e8b90af7a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.616291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.616953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.617238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.617562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] PATH_INFO: `/v3/users/0086f32849da40e39473b6be830b5501` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.621338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] RBAC: Authorizing `identity:get_user(user_id=0086f32849da40e39473b6be830b5501)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:46.622825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd1775-aedf-4df6-89e1-809fdf8a575b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:46.624235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f589-c42b-4258-b0fb-f807eac97ce8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.624459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 75/149] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/users/0086f32849da40e39473b6be830b5501 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:46.625650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee4def-e6f6-43bc-a8ca-0719dcf238f2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.625933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee4def-e6f6-43bc-a8ca-0719dcf238f2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.626209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee4def-e6f6-43bc-a8ca-0719dcf238f2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.627412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 76/150] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:46.632852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee4def-e6f6-43bc-a8ca-0719dcf238f2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.646909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:46.689156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.689830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.690113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.690387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.691107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:46.691410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:46.692822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24afbf-af91-43b6-b432-698e77b40ca0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:46.702949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 75/151] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:46.704216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60ca4-42de-403c-b31f-858120138552 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.704506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60ca4-42de-403c-b31f-858120138552 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.704785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60ca4-42de-403c-b31f-858120138552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.724441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:46.732219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-17b60ca4-42de-403c-b31f-858120138552 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:46.733433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-17b60ca4-42de-403c-b31f-858120138552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:46.757623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee4def-e6f6-43bc-a8ca-0719dcf238f2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:46.826861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:46.827764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:46.828198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:46.828621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:46.831634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 76/152] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:46.832751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60ca4-42de-403c-b31f-858120138552 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:46.934009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:46.936091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.002691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60ca4-42de-403c-b31f-858120138552 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.005729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.017523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.059188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 77/153] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:47.060214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.075685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.076436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.076746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.077159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] PATH_INFO: `/v3/users/2c0d716ca1e440078473e7a5edb62e71` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.078387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] RBAC: Authorizing `identity:get_user(user_id=2c0d716ca1e440078473e7a5edb62e71)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.079966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.086028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 77/154] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:46 2022] GET /identity/v3/users/2c0d716ca1e440078473e7a5edb62e71 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:47.086788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.172153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c247f08-a6a0-482c-923a-79b07455d9b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.219241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.220651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.220934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.221209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.252141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:47.257152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:47.258002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:47.258913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 78/155] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:47.259649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.308562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0a7-d72e-410d-a962-370d43d576da None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.335568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.378033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.378861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.379143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.379427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.381850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.383311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.385833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 78/156] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:47.386391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.428312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.470374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84338b-89c2-4de5-86bf-d67d030ae1bf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.535642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309699e-401d-45fc-b483-27651092bcfc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.538219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.538866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.539141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.539410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.540597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.542554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.544248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 79/157] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:47.545018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.583476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.584095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.584372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.585244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.586141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:47.586391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.588113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.600311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 79/158] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:47.601127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.724851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.729446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952ca9-23c1-4daa-8ba6-9c7a22f81f4d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.762775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:47.776065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae6dd-747a-4b1c-8c39-44a9fd5c9cb6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:47.793380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.794087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.794366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.794638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/2c0d716ca1e440078473e7a5edb62e71/roles/446c8078d9264b6fb1e96bd5d8255ed8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.798115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, user_id=2c0d716ca1e440078473e7a5edb62e71, role_id=446c8078d9264b6fb1e96bd5d8255ed8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.799946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.821068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 80/159] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:47 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/users/2c0d716ca1e440078473e7a5edb62e71/roles/446c8078d9264b6fb1e96bd5d8255ed8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:47.821870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:47.855167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:47.856130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:47.856561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:47.857030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:47.858018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=0086f32849da40e39473b6be830b5501) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:47.858496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:47.865473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:47.876096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 80/160] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/role_assignments?user.id=0086f32849da40e39473b6be830b5501&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:47.992202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcf0a2-bb97-4d85-acf0-ae796f3d6cfc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:48.035617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:48.036276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:48.036551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:48.036820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:48.040613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:48.043449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:48.045385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 81/161] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:47 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:48.051132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:48.188574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4015f-c06d-443c-8969-4098faffe3a1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:48.225807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:48.226493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:48.226783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:48.227061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:48.258679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:48.303972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:48.305463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:48.424006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 81/162] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:48.429947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:48.476431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:48.559131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c38e5-b98a-41b6-9947-63d218df9d93 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:48.598140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:48.598904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:48.599189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:48.599469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:48.600689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:48.602156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069556d-1691-45a5-8731-41ab684efe0e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:48.603875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:48 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:48.610200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:48.705385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:48.754046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77775d43-ea4c-4d19-b58b-0e0b1501461e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:48.795569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:48.796326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:48.796513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:48.796728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:48.797544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:48.797858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:48.799314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fdf9b-13ff-4d4c-b104-f06aadc7e482 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:48.810769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:48 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=1bee8395f89b42498b722eee5ee49356 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:49.112353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9dcbc-7f16-4ede-9bf8-54c7511d9e1e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.112353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9dcbc-7f16-4ede-9bf8-54c7511d9e1e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.112353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9dcbc-7f16-4ede-9bf8-54c7511d9e1e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.114705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd775d8f-cdff-46d0-9fb7-6c41b974d0ae None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.115149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd775d8f-cdff-46d0-9fb7-6c41b974d0ae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.115558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd775d8f-cdff-46d0-9fb7-6c41b974d0ae None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.117027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 83/165] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:49.117358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 83/166] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:49.122781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.123332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.123808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.127980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.128482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.128955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.158490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:49.160194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:49.166186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:49.167781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:49.329576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 84/167] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:49.339144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 84/168] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:49.377833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:49.381349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:49.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:49.513448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:49.624472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e17c3-6522-4a55-b2d9-e2772eb7d3d7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:49.626190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd8e6-3201-443e-9d6f-fad3c1c1d65a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:49.665252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:49.666849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.667300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.667991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.679068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-18f0ef2e-9995-48d5-826a-74e0e75fb82f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:49.685577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:49.686804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:49.687684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:49.689943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 85/169] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:49.691256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9672f9-94bd-4fd4-aace-f99e9270fc95 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.691682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9672f9-94bd-4fd4-aace-f99e9270fc95 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.692098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9672f9-94bd-4fd4-aace-f99e9270fc95 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.697823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 86/170] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:49.703825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.704301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.705283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.725111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:49.726865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:49.763480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:49.764146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.764423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.764699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.800680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 87/171] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:49.806804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:49.820679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:49.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:49.829818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:49.830572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:49.841864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 85/172] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:32:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:49.843017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:49.850364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:49.943344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6020ac-b2b7-484f-92c5-7450e440a7e0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:49.987572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:49.988202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:49.988486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:49.989171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:49.989937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:49.990244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:49.991643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.005205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 88/173] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.011532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.051461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894392cc-18f6-42bb-9818-218bd929114b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.067553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.091743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.092371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.092652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.092923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.093751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:50.094059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.095477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7d98-97b3-475c-920d-9c1ae9147655 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.103529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 86/174] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:32:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.106731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a7db-1301-4197-bae5-81635725b735 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.107237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a7db-1301-4197-bae5-81635725b735 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.107715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a7db-1301-4197-bae5-81635725b735 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.109194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 87/175] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:50.110121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a7db-1301-4197-bae5-81635725b735 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.118996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.152318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ec7d-6b9d-47ac-a5ee-b939bd64fdaa None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.190741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.191440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.191721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.192048 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.203593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-94892bab-9b7f-49b1-a485-e8c416718891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:50.208564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:50.209453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:50.210229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 89/176] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:50.211707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44f79-64a9-4e01-84ca-c89b53e36d24 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.211707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44f79-64a9-4e01-84ca-c89b53e36d24 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.211707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44f79-64a9-4e01-84ca-c89b53e36d24 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.217383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 90/177] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:50.217383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b44f79-64a9-4e01-84ca-c89b53e36d24 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.241523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a7db-1301-4197-bae5-81635725b735 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.280789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.281558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.281843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.282120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.283347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.284717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be158486-dfbb-4348-b945-6a91398abf6e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.291050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 88/178] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.291050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130710e4-d84b-4409-8c39-29024437072a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.291050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130710e4-d84b-4409-8c39-29024437072a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.291050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130710e4-d84b-4409-8c39-29024437072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.306341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-130710e4-d84b-4409-8c39-29024437072a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:50.307639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-130710e4-d84b-4409-8c39-29024437072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:50.333014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b44f79-64a9-4e01-84ca-c89b53e36d24 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.347741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.371271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.372088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.372376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.372654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] PATH_INFO: `/v3/users/02c848f5b953440fb481cbbd44edd421` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.373880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] RBAC: Authorizing `identity:get_user(user_id=02c848f5b953440fb481cbbd44edd421)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.375396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.377021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 91/179] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/users/02c848f5b953440fb481cbbd44edd421 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.377812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.382890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 89/180] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:50.386488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.386870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.387217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.396077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.407667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:50.409170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:50.482315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 90/181] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:50.482858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.499807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc95dd-9085-4f79-b1ad-04611e2794f3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.536870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.537865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.538330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.538782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.539818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:50.540303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.542070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.551837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 92/182] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.553068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.607450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725bd0-4828-400d-87d3-10f02481bdc5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.609822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.627225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.643885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.644515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.644799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.645073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.664407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252195e-0750-467d-b2cd-0a0e7937cfa6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.699421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.700041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.700325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.700592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.720587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.722505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.767904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.769315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.835939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 91/183] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:50.836791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.842971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.852284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:50.887438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 93/184] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:50.888271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.944567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93093321-1489-4086-a92e-fe4a547c1295 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:50.979424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:50.980063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:50.980349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:50.980628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:50.981818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:50.983253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:50.984858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 92/185] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:50.985646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:50.988943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b613-c411-4d97-9f71-77da3ee35dae None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.023610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.024181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.024460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.024735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.034613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:51.039546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:51.040448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:51.041278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 94/186] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:51.041983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.059713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.071228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.090294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7ddf-b54f-4a3a-95c8-9e3d6fea5130 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.123557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.124196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.124476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.124752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.138067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.139539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb1534-d4b9-4b7a-99a3-30b38a155083 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.141208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 93/187] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:50 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.142482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2cd16-e6d7-4264-8381-5fe2ee7797b9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.142594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb04b6-c81d-4573-b845-26e1aadbd2c0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.143002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2cd16-e6d7-4264-8381-5fe2ee7797b9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.143084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2cd16-e6d7-4264-8381-5fe2ee7797b9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.144256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 94/188] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:51.144959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2cd16-e6d7-4264-8381-5fe2ee7797b9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.180001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.180639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.180918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.181332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] PATH_INFO: `/v3/projects/052d476a4a63489fa6de1b600a77e9fd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.182628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] RBAC: Authorizing `identity:get_project(project_id=052d476a4a63489fa6de1b600a77e9fd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.184111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.190891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 95/189] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/projects/052d476a4a63489fa6de1b600a77e9fd => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.190891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.248779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2cd16-e6d7-4264-8381-5fe2ee7797b9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.277498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.282165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.284904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.285583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.285870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.286139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.287292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.288196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38e18-072e-4cd6-8529-ea8723e8c81d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.288740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.290470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.294195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.323749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.324453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.324764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.325036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.325802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.327254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.348208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 96/191] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:51 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:32:51.350373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.408214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9745-aa5d-401f-8cd5-d2c3948eed6a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.448304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.448952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.449228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.449535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.450262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:51.450565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.452015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de19e3-68a8-4dd1-89ea-cc948e51cefd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.461383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 96/192] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.462648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.462993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.463334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.469390 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dbcd4-b0bc-46a1-aac1-8913c650b256 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.483809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:51.485039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:51.512054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.512688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.512963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.513232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.536421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.553855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.566982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 97/193] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:51.568063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.598974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.599974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.701465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e356-ea3a-48dc-88d5-de6a5c7d3b4f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.721203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 97/194] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:51.721514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.741111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.742094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.742569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.743015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.743975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=052d476a4a63489fa6de1b600a77e9fd, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:51.744996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.746673 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.753125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 98/195] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=052d476a4a63489fa6de1b600a77e9fd&role.id=1bee8395f89b42498b722eee5ee49356 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.754231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.798336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.849790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:51.901025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b0b59-df37-4be4-ade0-9d0cf7140702 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.937696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90135d4c-b28b-464e-ad06-bd23dc7974ab None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:51.975505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.976141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.976417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.976688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:51.977507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=02c848f5b953440fb481cbbd44edd421) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:51.977817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:51.979820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:51.986160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/role_assignments?user.id=02c848f5b953440fb481cbbd44edd421&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:51.986872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:51.997284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:51.998005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:51.998875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:51.999160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.000442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.002442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.004983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 99/197] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.011927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.185677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48814-1bbf-49f4-967c-d958d6c3141d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.194095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfdda-b864-4702-9728-de763bb6fd59 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.223536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.237810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.252569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.253221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.253534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.253812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.272763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:52.278125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:52.278351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:52.279368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:52.280328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 99/198] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:52.280969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.282102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.282634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.283103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.284537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.286399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.288575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 100/199] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.289642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.420010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49dcdd-03cf-4987-86b7-b4414e793552 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.420617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dd3a3-d247-4b5e-aee7-f932081eb91d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.457834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.458005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.458523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.458808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.459090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.459532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.459798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:52.460103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.460468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.460984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.461517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.471141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 101/200] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.471966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.513023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.535015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.541800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.543691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.585265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8c09-c207-49cc-a273-2ec888a92e50 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.621054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.621707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.621991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.622270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.623200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=f6a14cf0b8d34e67bdf994cdacf99c43) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:52.623376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.624805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.630869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 102/201] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/role_assignments?user.id=f6a14cf0b8d34e67bdf994cdacf99c43&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.631541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.658954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 100/202] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:52.665479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.831451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.846318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56dbb6-1926-454f-a328-bbc08cb4a547 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.865452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:52.884079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515658d-d861-4dee-96e9-90bd6ad60630 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:52.897930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.898780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.899058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.899334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] PATH_INFO: `/v3/users/2c0d716ca1e440078473e7a5edb62e71` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.902341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] RBAC: Authorizing `identity:get_user(user_id=2c0d716ca1e440078473e7a5edb62e71)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.903791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.911201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 103/203] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/users/2c0d716ca1e440078473e7a5edb62e71 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.913087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:52.960015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:52.960667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:52.960945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:52.961219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:52.963045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:52.965572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:52.969968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 101/204] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:52.977876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:53.119098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a17a-1303-48ea-89d6-fcbff25176dd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:53.131565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baa55-3a6a-45f7-8d38-dd65e763c877 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:53.159946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:53.160696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.160974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.161252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.162358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=f6a14cf0b8d34e67bdf994cdacf99c43) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:53.162673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:53.164130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:53.171870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 102/205] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/role_assignments?user.id=f6a14cf0b8d34e67bdf994cdacf99c43&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:53.200370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:53.201009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.201287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.201597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.267888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:53.287651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:53.289201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:53.410079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 104/206] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:53.415397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:53.428240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:53.522290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5a4a-1abc-4923-b219-7196f6c7ee4c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:53.557806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:53.558695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.559123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.559543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.560898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:53.562524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ca4f-a7de-43a0-a670-cb0df60a88fe None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:53.564689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 103/207] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:53 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:53.570226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:53.690717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:53.710074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b45ee-7706-480d-a363-865daa34d842 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:53.747240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:53.748159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.748586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.749005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.749992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, scope.project.id=2ed50bad29524f778785a3e24c00ef0f, user.id=2c0d716ca1e440078473e7a5edb62e71) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:53.750450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:53.752046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499512f-4dcd-4758-bf86-32a442f57a24 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:53.758964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 105/208] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:53 2022] GET /identity/v3/role_assignments?user.id=2c0d716ca1e440078473e7a5edb62e71&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:53.816305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ced75f-b33a-4b9d-bf97-617a3165a8f0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.816999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ced75f-b33a-4b9d-bf97-617a3165a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.817464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ced75f-b33a-4b9d-bf97-617a3165a8f0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.819249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 104/209] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:53.828317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.828833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.829320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.858141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:53.859641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:53.934272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d07e-41de-4159-a856-7451e90a645e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.934932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d07e-41de-4159-a856-7451e90a645e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.935425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d07e-41de-4159-a856-7451e90a645e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.937035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 105/210] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:53.946990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:53.947665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:53.948753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:53.953042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 106/211] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:53.983524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:53.985183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:54.006038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.094084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 106/212] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:54.122460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:54.130371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.141466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:54.157154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7cfc-6464-455d-98b3-665945001a99 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.208189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.209378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.210285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.210974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.224206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:54.232343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:54.233223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:54.234024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:54.236614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 107/213] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:54.242320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.259328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15a53-211a-431f-99af-39c058d34b50 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.296570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.297549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.297549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.297826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.298956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:54.300416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:54.302209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 107/214] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:54.308458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.356253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a7a5-12a4-4e63-9025-babc3a052d0f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.390881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:54.396094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.396980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.397515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.398095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.399128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:54.399629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:54.401330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:54.407443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:54.413233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 108/215] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:54.419334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9622a3-03d3-47b1-8cc0-87a6468290e9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.420424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.456757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.457699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.458088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.458549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.459287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:54.460889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:54.493661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 108/216] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:54 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:32:54.534049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da00b-6e0a-4e8c-b34c-ea8830a80b2a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.575007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.575929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.576346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.576791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] PATH_INFO: `/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.593485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] RBAC: Authorizing `identity:get_user(user_id=dc1ed28fd1b9489b8492b09d3bc346c5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:54.595201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40d20-8a6a-4b17-b62c-cba7d2bfe879 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:54.597135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 109/217] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:54.602930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.719905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86059-ca67-4df1-b78e-752e9e76e0be None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:54.749546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:54.755679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:54.756705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.757332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.758025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.830181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:54.831669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:54.920671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d709e2-4b32-4773-a0fd-599ebe8e4d2c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.921146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d709e2-4b32-4773-a0fd-599ebe8e4d2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.921639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d709e2-4b32-4773-a0fd-599ebe8e4d2c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.923322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 110/218] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:54.928320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:54.928609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:54.928938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:54.946141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 109/219] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:54.952841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:54.953085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:54.954074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:55.004704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.018978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.035932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 111/220] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:55.059447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.068745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e5f6-0c35-4797-b58f-e05d076621a6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.105103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.105801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.106241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.106692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.108033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:55.109691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:55.111880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 110/221] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:54 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:55.119547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.224644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf619dd-c3f4-442e-9aa6-3ab58c4e2791 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.268721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.269656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.270091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.270539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.283496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:55.288702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:55.289790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:55.290756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:55.292918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 112/222] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:55.298718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.343887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.350492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120889d1-09a3-4b18-8dc2-1e61396a5f83 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.352991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.397619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.399001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.399742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.400170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.402332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=dc1ed28fd1b9489b8492b09d3bc346c5) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:55.402800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:55.404903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:55.413371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/role_assignments?user.id=dc1ed28fd1b9489b8492b09d3bc346c5&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=1bee8395f89b42498b722eee5ee49356 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:55.424783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5df783-7f0c-4d53-b537-5a56aad31d36 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.471449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.472351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.472780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.473223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.474114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:55.474566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:55.476163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2c65b-a60c-423b-85dc-2530b39ac898 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:55.492667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 113/224] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:55.499359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.615643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052886e-1829-499d-944a-51c886abde7e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.616260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052886e-1829-499d-944a-51c886abde7e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.616741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052886e-1829-499d-944a-51c886abde7e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.618440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 114/225] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:32:55.627042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.627677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.628174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.651562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643b81-9783-42d1-a469-636df1f39912 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.652458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:55.653963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:55.694707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.695502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.695786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.696066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.698091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:55.700318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:55.702559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:55.709494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.764936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.792256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 115/227] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:55.835815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:55.858242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294ec5-ce63-4bab-920c-43e8e356c771 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:55.904970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:55.905569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:55.905855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:55.906131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:55.908652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:55.910953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:55.914809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:55.916836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:55.922635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:56.025442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d8f9e-d2fc-469a-a042-617fd5610304 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.093537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.094215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.094500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.094781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.105948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:56.109223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:56.115685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:56.116776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:32:56.117762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:56.118410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799211e-553b-42f5-8da8-ef192ed96231 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.120488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 116/229] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:32:56.130411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:56.175955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.180207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.180822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.181314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/f6a14cf0b8d34e67bdf994cdacf99c43/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.184415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, user_id=f6a14cf0b8d34e67bdf994cdacf99c43, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:56.186900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:56.212296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 114/230] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:55 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/f6a14cf0b8d34e67bdf994cdacf99c43/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:32:56.286506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:56.290900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864057-a8db-4b45-b559-47786d8758ba None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.341737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.342733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.343246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.343724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.344659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:56.345172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:56.346817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:56.361542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 117/231] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:32:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:56.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:56.485605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6162a-fdb1-4c70-ba30-89ba272ce1df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.534878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.536301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.536818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.537297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.538829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:56.540483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:56.542622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 115/232] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:56 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:56.548337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:56.686899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a67fdd-4e80-4c9e-b0ae-c1182d33d3de None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.733465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.734129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.734411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.734678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.738154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:56.739551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebb02-4edb-4788-a5fc-0e3edb1e255c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:56.741217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 118/233] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:56 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:56.747619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:56.794747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:56.885228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c6fa-e75d-4af6-8c92-be47230cc86b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:56.928582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:56.929264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:56.929570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:56.929843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/f6a14cf0b8d34e67bdf994cdacf99c43/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:56.933179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, user_id=f6a14cf0b8d34e67bdf994cdacf99c43, role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:56.934780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39614280-e822-4858-adb7-eda8151e1adb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:56.956608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 116/234] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:56 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/f6a14cf0b8d34e67bdf994cdacf99c43/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:57.093972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468c6f-63f1-418b-9828-01b4f1996b85 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.094476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468c6f-63f1-418b-9828-01b4f1996b85 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.094476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a468c6f-63f1-418b-9828-01b4f1996b85 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.095805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 119/235] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:57.106307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.106591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.106878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.132722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:57.133940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:57.232699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1cc89-e618-458f-a712-7b5d0846d6af None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.233321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1cc89-e618-458f-a712-7b5d0846d6af None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.233854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1cc89-e618-458f-a712-7b5d0846d6af None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.235679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 120/236] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:57.238981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 117/237] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:57.241203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.241770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.242270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.264075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:57.272943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:57.274413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:57.289010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:57.301216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:57.358776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 121/238] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:57.385930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:57.402556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b657-3930-47a1-8078-ebbc230b4af9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:57.444581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:57.445551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.445998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.446412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.447842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:57.449580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:57.451594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 118/239] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:57.457019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:57.525238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8ea44-1629-41ef-83ff-65505ddd6c49 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:57.556725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:57.574806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:57.575475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.575754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.576028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.579373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63941f3-5a94-4f14-8ecc-0d64a160b331 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:57.605207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:57.610231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:57.611075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:32:57.611834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 122/240] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:57.619201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:57.626491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:57.627418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.627918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.628682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.629607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:57.631259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:57.659835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 119/241] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:32:57 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:32:57.679774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:57.771159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1dd9e-cb16-4b3d-9706-16437363a218 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:57.809744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:57.810431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:57.810720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:57.810997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:57.811756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:57.812025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:57.813458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:57.824424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 123/242] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:57.830295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:57.971773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3839-1b22-4534-8fe7-fc28a22dc249 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.009772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.011492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.011916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.012327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] PATH_INFO: `/v3/users/c6ec1007124a42b1841884fe10acfa42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.023645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.031211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] RBAC: Authorizing `identity:get_user(user_id=c6ec1007124a42b1841884fe10acfa42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.033099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44021-deb0-4e98-8dd6-46de8e054eeb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.036182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 120/243] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:57 2022] GET /identity/v3/users/c6ec1007124a42b1841884fe10acfa42 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:58.042509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.140734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.158780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6316-b092-4340-8add-451f5fc3721f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.159280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6316-b092-4340-8add-451f5fc3721f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.159736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6316-b092-4340-8add-451f5fc3721f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.161287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 121/244] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:58.167087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.167688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.168160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.168435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7280f-31e5-4df8-8789-483e37971190 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.204715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:58.206354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:58.207774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.208407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.208684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.208953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.292916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.294790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.296176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:32:58.321098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.386861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.409684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 124/246] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:32:58.416485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.427741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2c3a9-95f2-4a4c-b293-b4cd5748a5e2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.455485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.463847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.464585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.464863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.465122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.477020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:58.483248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:58.484152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:58.484919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 123/247] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:58.490361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.534442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feb90-6c36-4af7-a4e2-d54ba590553e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.571557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.572523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.573336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.573855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.575397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.577141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.579089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 125/248] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:58.587359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.600546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60344e-79e6-4041-bca6-0f9ac4406bdd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.643552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.644190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.644470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.644739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.645504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:58.645812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.647252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.657210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.658316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 124/249] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:58.664574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.719136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:58.725508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134d5e-1c74-42a6-8760-44af217672b7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.763364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.764224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.764672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.765083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.766102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=c6ec1007124a42b1841884fe10acfa42) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:58.766550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.768170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.774459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 126/250] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/role_assignments?user.id=c6ec1007124a42b1841884fe10acfa42&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:58.785765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3efffb-58e5-45a8-9480-6294b69f5c35 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:58.825255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:58.826172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.826616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.827029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] PATH_INFO: `/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.828468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] RBAC: Authorizing `identity:get_user(user_id=dc1ed28fd1b9489b8492b09d3bc346c5)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:58.830147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063f6c-7fb5-4080-b609-f8b9103514e9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:58.832354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 125/251] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:32:58.838551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:58.964142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7532-4600-4e64-a026-1e8bad0f3164 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.964974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7532-4600-4e64-a026-1e8bad0f3164 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.967601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7532-4600-4e64-a026-1e8bad0f3164 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.969452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 126/252] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:58.974567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:58.975122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:58.975639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:58.985451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46b162-585b-49f9-9e7f-558d3acb17df None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.003976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:59.008100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:59.013621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:32:59.035669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:59.036337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.036621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.036947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.038219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:59.045636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:59.045636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 127/253] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:32:58 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:59.061256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:59.107462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 127/254] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:32:59.146938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:59.209794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8c78-3502-4904-905c-cb54cd4a4062 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.236674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:59.253332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:59.254290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.254716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.255133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/dc1ed28fd1b9489b8492b09d3bc346c5/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.263150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, user_id=dc1ed28fd1b9489b8492b09d3bc346c5, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:59.264860 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:59.294581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 128/255] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:32:59 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/dc1ed28fd1b9489b8492b09d3bc346c5/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:32:59.316688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536950fd-6714-470b-8da3-5ba7a749f371 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.367911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:59.368648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.368930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.369199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.380904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:32:59.395648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:32:59.396586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:32:59.397358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 128/256] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:32:59.403748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:59.464985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:59.550620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e141ff-5894-4496-b8fa-d8b8a8513640 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.587892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:59.589141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.589439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.589752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.590427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:32:59.590731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:59.592167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:59.605627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 129/257] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:59.611061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:59.734614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e8b2f-9ebd-477a-8e1d-16fff22f5e4e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.744677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:59.774751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:32:59.775399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.775678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.776186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.777474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:32:59.778925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e098b94-d5b9-41c9-abe7-334b1b0cd5a9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:32:59.780814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 129/258] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:32:59 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:32:59.786495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:32:59.929581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfffc-4920-42f0-ba08-8cac0928df83 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:32:59.933189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720111f4-a7ca-4d4c-9c25-dcc782bb1ee9 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.933515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720111f4-a7ca-4d4c-9c25-dcc782bb1ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.933793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720111f4-a7ca-4d4c-9c25-dcc782bb1ee9 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.935545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 130/259] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:32:59.937573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:32:59.940204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:32:59.940697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:32:59.941162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:32:59.976410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:32:59.978158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:00.006205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.006763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.007048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.007324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.060980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 131/260] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:00.098689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.108995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:00.110527 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:00.224582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 130/261] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:00.225861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.229395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:00.276682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4f78-ca9e-4709-9e3a-e599c3523c0d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:00.293275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:00.340800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.341478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.341759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.342028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.353106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:00.362618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:00.363508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:00.364368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 132/262] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:00.369686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cd5cc-33e7-44e8-be39-601dd64600fb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:00.371872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.410669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.411331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.411615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.411892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.413072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:00.418728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:00.420793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 131/263] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:00.430359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.491994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e991f-d342-4fb1-b8fe-2f8f3b90b6d9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:00.530853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.531497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.531779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.532074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.532851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:00.533153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:00.534653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:00.543678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 133/264] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:00.551627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:00.552655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.611556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:00.636371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1717-f6ae-4fd9-9129-b53df6e933f0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:00.740200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b4e4-0333-4771-a09e-663fb6122bd3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:00.762324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.762971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.763254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.763531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.764339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=f6a14cf0b8d34e67bdf994cdacf99c43) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:00.764655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:00.766172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:00.779532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:00.779968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 132/265] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/role_assignments?user.id=f6a14cf0b8d34e67bdf994cdacf99c43&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:00.780169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:00.780444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:00.780713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] PATH_INFO: `/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:00.781978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] RBAC: Authorizing `identity:get_user(user_id=f6a14cf0b8d34e67bdf994cdacf99c43)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:00.783387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13cf97-a986-422e-aaef-711bedea7b28 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:00.785006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 134/266] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/users/f6a14cf0b8d34e67bdf994cdacf99c43 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:00.795066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:00.956092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8384-efde-4112-89a4-3a916823afc2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:01.000680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:01.001316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.001625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.001915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.007944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:01.113162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:01.114614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:01.126380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7e52-ebf0-49df-b9ef-c89cc2678725 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.126687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7e52-ebf0-49df-b9ef-c89cc2678725 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.126917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7e52-ebf0-49df-b9ef-c89cc2678725 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.128419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 135/267] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:01.133839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856086c-a734-4362-9934-ef3623fa178f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.134122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856086c-a734-4362-9934-ef3623fa178f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.134401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856086c-a734-4362-9934-ef3623fa178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.186518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4856086c-a734-4362-9934-ef3623fa178f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:01.187741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4856086c-a734-4362-9934-ef3623fa178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:01.237594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 133/268] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:01.244166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:01.318904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:01.341523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 136/269] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:01.365590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856086c-a734-4362-9934-ef3623fa178f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:01.419536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:01.422083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52dcc-595f-49b6-8cea-447c1096142c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:01.489566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:01.490242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.490527 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.490804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.498234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:01.499716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:01.501838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 134/270] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:01.507244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:01.561952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856086c-a734-4362-9934-ef3623fa178f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:01.626385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:01.627008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.627248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.627481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.646962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0cf1e22a-2698-4803-baa7-c8a037a0f00d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:01.652637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:01.653542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:01.654333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 137/271] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:01.661451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37c46-c49a-4a2c-a48e-514331f6b38c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.661451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37c46-c49a-4a2c-a48e-514331f6b38c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.661451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37c46-c49a-4a2c-a48e-514331f6b38c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.662075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 138/272] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:01.662949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed37c46-c49a-4a2c-a48e-514331f6b38c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:01.679869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e15064-685a-46ef-9692-862f4e9425ff None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:01.682509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:01.715615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:01.716232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.716509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.716778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.717589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=f6a14cf0b8d34e67bdf994cdacf99c43) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:01.717900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:01.719325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c831-0d3d-45c1-913a-bd35e964e089 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:01.725259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 135/273] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/role_assignments?user.id=f6a14cf0b8d34e67bdf994cdacf99c43&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:01.726470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.726749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.727018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.746534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:01.747727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:01.789378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:01.829641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed37c46-c49a-4a2c-a48e-514331f6b38c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:01.857779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 136/274] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:01.895500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:01.897449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:01.898175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:01.898547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:01.898830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:01.899564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:01.899869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:01.901375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:01.921205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 139/275] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:01.927007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.005992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f5009-61fc-4642-8468-6ecdc889e22f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.029799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.043417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.044072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.044348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.044627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.045919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.047372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2f405-aea3-46b6-aa6c-80f38155708b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.049806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 137/276] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:02.050719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395381-f06a-4ab4-ab19-6c350adac19e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.051002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395381-f06a-4ab4-ab19-6c350adac19e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.051276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395381-f06a-4ab4-ab19-6c350adac19e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.052613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 138/277] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:02.052969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485d3b-845b-4863-9ff3-723016fbe217 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.055013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395381-f06a-4ab4-ab19-6c350adac19e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.096626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.097404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.097798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.098144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] PATH_INFO: `/v3/users/f327d7250197493490b2946a058dd892` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.117990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] RBAC: Authorizing `identity:get_user(user_id=f327d7250197493490b2946a058dd892)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.120233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d99772-6f3e-4c50-b0ce-eec7ac19073f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.122444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 140/278] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:01 2022] GET /identity/v3/users/f327d7250197493490b2946a058dd892 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:02.123582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170210f-2697-41ea-802e-86e19152f280 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.123866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170210f-2697-41ea-802e-86e19152f280 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.124137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170210f-2697-41ea-802e-86e19152f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.141859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.149718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a170210f-2697-41ea-802e-86e19152f280 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:02.150598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a170210f-2697-41ea-802e-86e19152f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:02.176474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395381-f06a-4ab4-ab19-6c350adac19e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.213053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.213776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.214055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.214328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.215016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.216466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.230522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 141/279] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:02.231589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170210f-2697-41ea-802e-86e19152f280 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.249942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 139/280] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:02 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:02.258201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.298573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.366754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170210f-2697-41ea-802e-86e19152f280 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.394497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90c05-c4a5-4540-976a-1231ef5aa0b3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.407495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.407495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.407732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.407953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.408743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, user.id=f327d7250197493490b2946a058dd892, scope.system=all) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:02.409776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.410673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f36b5-592a-4245-8c8b-d441f4030e6a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.414593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.417874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 142/281] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/role_assignments?user.id=f327d7250197493490b2946a058dd892&scope.system=all&role.id=1bee8395f89b42498b722eee5ee49356 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:02.419472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b023-4124-4576-9942-23a9293e9646 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.420146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b023-4124-4576-9942-23a9293e9646 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.420605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b023-4124-4576-9942-23a9293e9646 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.422290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 143/282] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:02.429731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.430010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.430284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.442759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.443433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.443716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.443993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.454051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:02.454051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:02.462624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:02.471235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:02.472174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:02.473259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 140/283] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:02.479913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.554497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 144/284] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:02.577777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.594739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.622175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c681b-6200-4747-9a23-5e8c32d1ea9c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.669632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.670189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.670470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.670745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.671538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:02.671833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.673245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.683735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 141/285] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:02.689246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.715539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e62be-f3a1-499b-b25d-a10061b921ad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.747691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.755549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.756294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.756605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.756939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.769370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:02.774826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:02.775707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:02.777652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 145/286] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:02.785927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.797955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b128fd-0b53-4efd-b7be-f10c0f7f0112 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.837205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.837893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.838175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.838495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] PATH_INFO: `/v3/users/c6ec1007124a42b1841884fe10acfa42` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.840864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] RBAC: Authorizing `identity:get_user(user_id=c6ec1007124a42b1841884fe10acfa42)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.842355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.844277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 142/287] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/users/c6ec1007124a42b1841884fe10acfa42 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:02.849603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:02.865400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:02.915722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7c1e-1770-4ea0-88a6-3724e55bfce6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:02.957168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:02.958344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:02.958661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:02.958939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:02.959668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:02.959975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:02.961384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:02.972782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 146/288] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:02.979621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:03.027951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80530-3914-4b77-ad95-0af7ba5cb31f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.079141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:03.095437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.096090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.096371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.096649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.098845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.100301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:03.102919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 143/289] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:03.109865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:03.190988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148a7a6-0ee9-415f-b074-a23982ecd591 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.227489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:03.255103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.255758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.256042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.256316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] PATH_INFO: `/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.257636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] RBAC: Authorizing `identity:get_user(user_id=dc1ed28fd1b9489b8492b09d3bc346c5)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.259090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:03.261515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 147/290] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:02 2022] GET /identity/v3/users/dc1ed28fd1b9489b8492b09d3bc346c5 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:03.268076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:03.271281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f5017-e56b-480c-8abc-dd572f8f9774 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.341187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.341900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.342185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.342465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/c6ec1007124a42b1841884fe10acfa42/roles/446c8078d9264b6fb1e96bd5d8255ed8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.350347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, user_id=c6ec1007124a42b1841884fe10acfa42, role_id=446c8078d9264b6fb1e96bd5d8255ed8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.351856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:03.377517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 144/291] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:03 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/users/c6ec1007124a42b1841884fe10acfa42/roles/446c8078d9264b6fb1e96bd5d8255ed8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:03.438568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cce10-3d55-42d9-9596-0f710a92b980 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.461508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:03.480050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.480615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.480895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.481168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.559929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.561433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:03.676034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 148/292] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:03.681140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:03.794370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b132-aebd-42e5-b5ef-86f9240f61b3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.832410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.833066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.833351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.833666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.834848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.836364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920416e-7572-44b6-b24e-7e7332eaa229 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:03.839252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 145/293] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:03 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:03.845124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:03.867112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:03.952874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1965bd-b3a8-42b4-b744-9170ba7ceaf1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:03.989091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:03.989742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:03.990025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:03.990305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:03.991098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=dc1ed28fd1b9489b8492b09d3bc346c5) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:03.991413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:03.992910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716315f9-039e-4371-b5a4-90bce0ceba0e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:04.000236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 149/294] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:03 2022] GET /identity/v3/role_assignments?user.id=dc1ed28fd1b9489b8492b09d3bc346c5&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=1bee8395f89b42498b722eee5ee49356 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:04.694279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483c97-d5aa-445e-b27b-821b6157c2f8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:04.694785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483c97-d5aa-445e-b27b-821b6157c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:04.694887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483c97-d5aa-445e-b27b-821b6157c2f8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:04.696256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 146/295] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:04.705816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:04.706207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:04.706359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:04.734519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:04.735761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:04.766096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90accc96-0f10-4155-9fdd-ced5c5efc449 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:04.766421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90accc96-0f10-4155-9fdd-ced5c5efc449 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:04.766612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90accc96-0f10-4155-9fdd-ced5c5efc449 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:04.769360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 147/296] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:04.778763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:04.779199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:04.779569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:04.801151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:04.802537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:04.804879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:04.824426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 150/297] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:04.849575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:04.868631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:04.917590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 148/298] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:04.943603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:04.967974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a938c8f-3c07-4c21-a576-7b22d901023c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.007514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.008411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.008837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.009329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.021245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:05.027829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:05.028851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:05.029647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:05.032271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 151/299] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:05.039427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.111429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447776-6545-4d69-acfa-e0e4e4d226f3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.130675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.152167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.152642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.152930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.153207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.160118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01501c2-10c8-4808-9b58-b1f44bd4606c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.160585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.165572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9dd44797-ada3-423b-bc63-43649943f62e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:05.172781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:05.173698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:05.174470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:05.177181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 149/300] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:05.179154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29c6f-7bcd-4059-bf9d-eba25efe0ead None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.179434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29c6f-7bcd-4059-bf9d-eba25efe0ead None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.179703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29c6f-7bcd-4059-bf9d-eba25efe0ead None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.181114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 150/301] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:05.183280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29c6f-7bcd-4059-bf9d-eba25efe0ead None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.201886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.202510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.202957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.203083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.203764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:05.204165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.205514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7d8c-a875-4dba-8fb4-74b1843c0584 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.215046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 152/302] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:05.216995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.217870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.218364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.240349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:05.241619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:05.298228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29c6f-7bcd-4059-bf9d-eba25efe0ead None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.315409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 153/303] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:05.316350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.347950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.348805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.349260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.349564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.350416 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:05.350721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.352086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.360931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 151/304] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:05.361778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.392026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.430925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e158863-70f5-4cd3-bfcc-ad6cd03be625 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.431933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.468702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.469258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.469583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.469852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] PATH_INFO: `/v3/users/ff7a998d5f404923af272480a664ba5c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.476820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adab0a-0b90-47fe-a400-aef069af28a3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.483813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7a998d5f404923af272480a664ba5c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.485261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.486952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 154/305] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/users/ff7a998d5f404923af272480a664ba5c => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:05.487709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.519447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.520413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.520875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.521296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.522616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.524234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.526207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 152/306] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:05.527003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.592148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c3df-6093-4f80-9fb0-7b18b8848985 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.617515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.628760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.629406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.629718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.629992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] PATH_INFO: `/v3/users/f327d7250197493490b2946a058dd892` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.631158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] RBAC: Authorizing `identity:get_user(user_id=f327d7250197493490b2946a058dd892)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.632595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.634225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 155/307] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/users/f327d7250197493490b2946a058dd892 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:05.634968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.643584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5412d5-4639-4acf-9f51-a9e5a72d9ae2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.672305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:05.680692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.681607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.681898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.682322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.683123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, user.id=ff7a998d5f404923af272480a664ba5c, scope.system=all) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:05.683436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.684884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.690839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 153/308] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Jul 29 11:33:05 2022] GET /identity/v3/role_assignments?user.id=ff7a998d5f404923af272480a664ba5c&scope.system=all&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:05.691593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:05.780532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd128-6a3c-4e62-a364-b8c09f248e8b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.834025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.834667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.834951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.835225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] PATH_INFO: `/v3/groups` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.835320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654946ac-1fda-4a91-ba0e-daf23064d6a2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:05.835967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.839371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5a91d-e09a-4d8b-86cf-a925b2e4dfe2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.862398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 156/309] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Jul 29 11:33:05 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:05.892272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:05.892928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.893212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.893521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] PATH_INFO: `/v3/system/users/f327d7250197493490b2946a058dd892/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.895081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f327d7250197493490b2946a058dd892, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:05.896576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80ce3-94bc-4610-94d3-3406bf2932d9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:05.908269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 154/310] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Jul 29 11:33:05 2022] PUT /identity/v3/system/users/f327d7250197493490b2946a058dd892/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:05.966991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316a50-9657-4f78-a1b8-b833c86c80bd None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.967321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316a50-9657-4f78-a1b8-b833c86c80bd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.967550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316a50-9657-4f78-a1b8-b833c86c80bd None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.969392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 157/311] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:05.975386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:05.975691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:05.975954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:05.997792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:05.999047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:06.060622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:06.083055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 155/312] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:06.105977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316a50-9657-4f78-a1b8-b833c86c80bd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:06.167270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:06.225547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316a50-9657-4f78-a1b8-b833c86c80bd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:06.262031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:06.262746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:06.263029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:06.263307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:06.281397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:06.287128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:06.287979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:06.288755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:06.289333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:06.295699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:06.406646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aad0cd-0ff1-4e7d-95cb-61c568c8651e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:06.442578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:06.443224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:06.443509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:06.443786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:06.444508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:06.444815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:06.446219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:06.455648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:06.460880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:06.567115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe8ab1-14e1-4298-a0c7-fb648bbc92ab None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:06.580885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:06.603738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:06.604427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:06.604711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:06.604989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] PATH_INFO: `/v3/users/c6ec1007124a42b1841884fe10acfa42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:06.606200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ec1007124a42b1841884fe10acfa42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:06.607661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:06.609265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:06 2022] GET /identity/v3/users/c6ec1007124a42b1841884fe10acfa42 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:06.615021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:06.676030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:06.722893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b3a4-83b9-4155-a9a4-d64cea42e031 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:06.757561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:06.758193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:06.758477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:06.758755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:06.830969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:06.832431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:06.883630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:06.938098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:06.943841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:07.048165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d490-33da-4030-a450-06b85d949969 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:07.086166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:07.086995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:07.087282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:07.087558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:07.089383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:07.091282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989730fb-ffb5-476b-b63d-5bf05400e69b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:07.093280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:06 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:07.099067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:07.207863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f925c8-5091-453d-96cc-9495898b9e0a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:07.246506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:07.247135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:07.247417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:07.247693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:07.248476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b, user.id=c6ec1007124a42b1841884fe10acfa42) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:07.248786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:07.250266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd954a-da80-4453-bc48-8c9072a28f22 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:07.256683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:07 2022] GET /identity/v3/role_assignments?user.id=c6ec1007124a42b1841884fe10acfa42&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:07.800597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4c4d-1d43-4915-a1c6-26250d986237 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:07.800990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4c4d-1d43-4915-a1c6-26250d986237 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:07.801259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4c4d-1d43-4915-a1c6-26250d986237 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:07.802712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:07.807810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef0eea-2bd1-484c-84e6-d5658a7b118b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:07.808096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef0eea-2bd1-484c-84e6-d5658a7b118b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:07.808375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef0eea-2bd1-484c-84e6-d5658a7b118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:07.827104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a9ef0eea-2bd1-484c-84e6-d5658a7b118b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:07.828294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9ef0eea-2bd1-484c-84e6-d5658a7b118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:07.835773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:07.896826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 159/320] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:07.918661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4c4d-1d43-4915-a1c6-26250d986237 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:07.972139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.012751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9a1b-5197-4971-ba4e-c389ad9dad60 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.013065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9a1b-5197-4971-ba4e-c389ad9dad60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.013305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9a1b-5197-4971-ba4e-c389ad9dad60 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.014815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 160/321] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:08.019648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf074-06aa-4bee-879b-c5ed3e8820f2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.019930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf074-06aa-4bee-879b-c5ed3e8820f2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.020200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf074-06aa-4bee-879b-c5ed3e8820f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.028506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4c4d-1d43-4915-a1c6-26250d986237 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.040897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eaedf074-06aa-4bee-879b-c5ed3e8820f2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:08.043252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eaedf074-06aa-4bee-879b-c5ed3e8820f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:08.062963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.063532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.063813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.064090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.075214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:08.080410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:08.081341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:08.082486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 162/322] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:08.087221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.133830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 161/323] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:08.143876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69e7d-9674-4629-98a9-1495b06d93f0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.144169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69e7d-9674-4629-98a9-1495b06d93f0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.144448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69e7d-9674-4629-98a9-1495b06d93f0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.149496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 162/324] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:08.150466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.150760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.151086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.168553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:08.169786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:08.193539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd8bf-5fb7-47f5-9e71-78f2000f1a3f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.202579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.228391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.229597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.229896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.230191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.230993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:08.231299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.232692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.240301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 163/325] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:08.241065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.242171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 163/326] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:08.243269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.247800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.343409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62b43-7b87-4362-a614-14892f63fe38 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.349069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fee02c-a2ed-42b7-b87e-1857480bc239 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.376754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.377392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.377695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.377966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.382915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.383551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.383838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.384111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] PATH_INFO: `/v3/users/ff7a998d5f404923af272480a664ba5c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.385850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7a998d5f404923af272480a664ba5c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.387585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.388682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:08.389187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 164/327] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/users/ff7a998d5f404923af272480a664ba5c => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:08.389971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:08.393721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:08.394633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:08.395404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 164/328] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:08.396366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.435230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.456430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.495512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f6ecb-13e3-4452-af34-c8363ff1ca19 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.495932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d69630-6801-4c80-ba38-c3990e4cca8a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.529425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.530102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.530381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.530653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.530844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.531492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.531772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.531858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.532046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] PATH_INFO: `/v3/system/users/ff7a998d5f404923af272480a664ba5c/roles/446c8078d9264b6fb1e96bd5d8255ed8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.533208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.533525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff7a998d5f404923af272480a664ba5c, role_id=446c8078d9264b6fb1e96bd5d8255ed8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.534820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 165/329] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:08.534945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.535572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.543162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Jul 29 11:33:08 2022] PUT /identity/v3/system/users/ff7a998d5f404923af272480a664ba5c/roles/446c8078d9264b6fb1e96bd5d8255ed8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:08.544224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.653296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e7d6-fd51-4614-b410-44759fa7f2cd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.661547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.672165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bad44-7a9e-406a-95e7-8cc3e70878c2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.692971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.693743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.694028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.694296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.695127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:08.695435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.696875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.700923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:08.708356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 166/331] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:08.712355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.713069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.714117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.714226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.714320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] PATH_INFO: `/v3/groups` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.714604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.716031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.733456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 166/332] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Jul 29 11:33:08 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:08.832597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad837-2481-4ce0-ba18-43b86e95c0be None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:08.870988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:08.872029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:08.872521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:08.872972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] PATH_INFO: `/v3/users/f327d7250197493490b2946a058dd892` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:08.874435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] RBAC: Authorizing `identity:get_user(user_id=f327d7250197493490b2946a058dd892)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:08.876093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661223d7-4e8b-4cec-9a90-32516afd107d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:08.878357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 167/333] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/users/f327d7250197493490b2946a058dd892 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:08.883925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:08.990273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dee30-610c-410d-bc4b-4d24016c7a06 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:09.026419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:09.027051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:09.027337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:09.030865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:09.030865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] RBAC: Adding query filter params (role.id=1bee8395f89b42498b722eee5ee49356, user.id=f327d7250197493490b2946a058dd892, scope.system=all) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:09.030865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:09.030865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd870-7f09-4dad-886d-adcc345e0abd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:09.043052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 167/334] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Jul 29 11:33:08 2022] GET /identity/v3/role_assignments?user.id=f327d7250197493490b2946a058dd892&scope.system=all&role.id=1bee8395f89b42498b722eee5ee49356 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:10.672694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b2cc-65eb-440f-b333-d5ee9a10b51a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:10.673176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b2cc-65eb-440f-b333-d5ee9a10b51a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:10.673176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b2cc-65eb-440f-b333-d5ee9a10b51a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:10.674811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 168/335] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:10.681570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:10.682004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:10.682381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:10.705129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:10.706354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:10.754778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:10.792115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 168/336] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:10.833902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5b2cc-65eb-440f-b333-d5ee9a10b51a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:10.875627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:10.948651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5b2cc-65eb-440f-b333-d5ee9a10b51a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:10.984570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:10.985210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:10.985513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:10.985785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.001338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:11.007053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:11.007898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:11.009090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 169/337] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:11.016117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:11.143405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77206efc-c529-4a53-b017-6429dffc22dc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:11.196380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:11.197014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.197290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.197587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.199299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:11.199469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:11.200835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171f8c-b4cd-44ba-937c-30b4f51b0e36 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:11.216079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 169/338] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:11.221962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:11.349877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5315f5-1ed9-4cfe-b09a-1848a0197605 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:11.363054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952136-7bbe-446a-bf6f-0ccd32859c57 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.363387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952136-7bbe-446a-bf6f-0ccd32859c57 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.363619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952136-7bbe-446a-bf6f-0ccd32859c57 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.365009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 170/339] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:11.365847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:11.370806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.371091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.371367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.407223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:11.408426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:11.433713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:11.434420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.434701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.434973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] PATH_INFO: `/v3/users/ff7a998d5f404923af272480a664ba5c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.438411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7a998d5f404923af272480a664ba5c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:11.439882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:11.442608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 170/340] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:33:11 2022] GET /identity/v3/users/ff7a998d5f404923af272480a664ba5c => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:11.457020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:11.478886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:11.555218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:11.585795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:11.616531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdfd00-e405-4e0d-8a56-e401c23af7f3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:11.665976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:11.667191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.667476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.667747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.668540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] RBAC: Adding query filter params (role.id=446c8078d9264b6fb1e96bd5d8255ed8, user.id=ff7a998d5f404923af272480a664ba5c, scope.system=all) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:11.668844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:11.674593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0993-5b55-4b6d-900f-2cc0a9bb479d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:11.709326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Jul 29 11:33:11 2022] GET /identity/v3/role_assignments?user.id=ff7a998d5f404923af272480a664ba5c&scope.system=all&role.id=446c8078d9264b6fb1e96bd5d8255ed8 => generated 510 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:11.769196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648547-8e9a-4a13-a2fb-d6c8e026029c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:11.813872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:11.814545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.814825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.815098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.831561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:11.836600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:11.837472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:11.838261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 172/343] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:11.844131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e9b2-72d9-4a5f-9100-26a8b45d4077 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.844423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e9b2-72d9-4a5f-9100-26a8b45d4077 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.844704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e9b2-72d9-4a5f-9100-26a8b45d4077 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.846360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 172/344] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:11.847358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:11.853156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:11.853449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:11.853730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:11.889704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:11.890929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:11.892699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:11.933015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:11.993386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52623-8645-453f-b32d-ed924719d8c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.046200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.046837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.047119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.047396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.048121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:12.048429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:12.049851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:12.065240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 173/345] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:12.070813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.080003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:12.117242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.191309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:12.199116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3552-41e2-43b3-b203-e4db589233f0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.268985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.269569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.269857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.270133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.315585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a85023-b753-44d4-8eed-49edf39f4706 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.363201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.364000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.364286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.364485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:12.364587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.366058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825de026-5196-43a7-a448-a41df9efad25 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:12.378400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8c38797e-f699-40ca-bb42-c3266d02c1d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:12.385828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:12.386963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:12.387843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:12.388951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 174/347] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:12.393498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b39ed-39cf-41d6-8c7e-a40bb7d37f94 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.393854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b39ed-39cf-41d6-8c7e-a40bb7d37f94 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.394138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b39ed-39cf-41d6-8c7e-a40bb7d37f94 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.395535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 175/348] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:12.396278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b39ed-39cf-41d6-8c7e-a40bb7d37f94 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.436374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:12.487166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:12.504675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 174/349] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 11:33:12.506046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8576f8a-14dd-450a-8747-e3146fd2dfe3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.506339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8576f8a-14dd-450a-8747-e3146fd2dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.506620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8576f8a-14dd-450a-8747-e3146fd2dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.530495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c8576f8a-14dd-450a-8747-e3146fd2dfe3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:12.531610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c8576f8a-14dd-450a-8747-e3146fd2dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:12.534614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b39ed-39cf-41d6-8c7e-a40bb7d37f94 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.579165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.580170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.580644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.581109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.582051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:12.582549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:12.584164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:12.593007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 176/350] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:12.594230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.619069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 175/351] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:12.621721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ec1-4def-45eb-9465-80c5fd080995 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.622250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ec1-4def-45eb-9465-80c5fd080995 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.622779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ec1-4def-45eb-9465-80c5fd080995 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.625459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 176/352] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:12.627528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183ec1-4def-45eb-9465-80c5fd080995 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.699173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:12.731837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b5124-b355-4f27-af0b-edbd8ee6e276 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.763823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183ec1-4def-45eb-9465-80c5fd080995 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:12.773378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.775021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.775021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.775021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.776054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:12.777713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07fdff-1ec1-4bf8-9e75-f2e544ef39a2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:12.784856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 177/353] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:12.784856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.784856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.784856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.793162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:12.801152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:12.802369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:12.819505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:12.820141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:12.820431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:12.821100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:12.881655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 178/354] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:12.882829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:12.920565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:12.922456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:12.974696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.014309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90a4e7-d8ab-4dce-b02a-9217becaa931 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.055075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 177/355] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:13.055075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.063405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.064071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.064351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.065072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.076253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:13.076439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:13.081247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:13.082194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:13.082973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:13.084120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 179/356] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:13.084657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.180158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2baf18f-d549-4e24-a11f-c0d37fc11c87 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.231867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c3aba-da59-4eef-be91-724aaad1c606 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.232769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.233509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.233757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.234032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.248774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.250588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.253225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 178/357] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.253974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.275648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.285006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.286924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.286924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.286924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.302364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:13.310308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:13.311172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:13.311952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:13.314844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 180/358] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:13.314844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.356660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.379618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6828-7493-4dd0-a777-2a8d883a302d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.422605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.423012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.423140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.423377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.424628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.426109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.429749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 179/359] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.429749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.458426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7061-1c92-4f8f-8444-f02434433c72 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.496282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.497164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.497522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.497829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.498562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:13.498871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.500262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.509471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 181/360] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.509761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.550528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3be89d-1ef9-4c4d-af07-85a2fa1ed09d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.572742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.591081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.591707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.591985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.592255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.593038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=2ed50bad29524f778785a3e24c00ef0f) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:13.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.594798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ee5ba-aee2-4625-bfb4-9e904ae6ae3e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.603620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 180/361] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=1bee8395f89b42498b722eee5ee49356 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.606005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cee8e-2f78-4a89-829a-d6a90003fb35 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.606305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cee8e-2f78-4a89-829a-d6a90003fb35 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.606588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cee8e-2f78-4a89-829a-d6a90003fb35 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.608924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 181/362] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:13.613591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cee8e-2f78-4a89-829a-d6a90003fb35 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.624000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bb65-6c01-47ba-a7af-1ceba98948bb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.634407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.671862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.672502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.672784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.673065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.674395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:13.674395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.675615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.688247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 182/363] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.689542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.772794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cee8e-2f78-4a89-829a-d6a90003fb35 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.817192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.817866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.818540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.818540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.819658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.821101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110ecd-a22e-4be1-b8a3-6e99d9d277eb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:13.823540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 182/364] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:13.825196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.825491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.825876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.829721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1cee-dac4-439d-8757-e87980aec50c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:13.846320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:13.847532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:13.855033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.875235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:13.875866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:13.876145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:13.876414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:13.933606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:13.934555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:13.950925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:13.956962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:13.958488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.062542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cc783-ee0b-4f06-b4c8-c4f1a25e2dbb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.087915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 183/366] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:14.091551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.105946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.107637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.107637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.107637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.111037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.206321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.208379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.222296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928ca0-d52c-450e-a688-a4b315213824 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.227874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.263956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.264996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.268212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.268212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.268212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=2ed50bad29524f778785a3e24c00ef0f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:14.268458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.271471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.278810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 184/367] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.279999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.336766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 184/368] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:14.337872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.387726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.408681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b1e8-a620-4db5-9483-6210185e95ce None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.447161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.447881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.448160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.448435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.459645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:14.461563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d32d-d1a8-4555-95e4-1e819a7d7c96 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:14.465575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:14.466418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 185/369] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:14.467898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.476797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.502515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.503165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.503443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.503717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.505163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.506617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.508266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.509142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.573821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d44e-b214-40e0-b7ef-6a3aa8ca2790 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.610021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.610716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.611001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.611273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.612449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.613930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.615888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.621951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.627540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7acc-3b8a-4722-9d62-751fc1525922 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.633550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.669167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.669776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.670083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.670615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.671439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:14.671748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.673268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.683138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 186/372] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.684072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.728672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5554-b1b7-4ef1-9907-552c53eaa330 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.735963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.768736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.769389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.769694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.769965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.771140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.772590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.774621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 187/373] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.775396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.811954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01690d-6155-413c-8ea3-4b3754518726 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.850265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.851014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.851236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.851510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.852770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:14.854240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:14.856830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 187/374] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:14.857404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:14.863899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:14.909053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a385c8-6e05-4d11-9c5c-73b85df19bc2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.948707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:14.949745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:14.950307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:14.950899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:14.967131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916c7e9-0cb1-408e-908a-4717e3f5166e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:14.978402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:15.004702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:15.005038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.005253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.005573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.006344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:15.006654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.008201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.015903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 188/375] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=1bee8395f89b42498b722eee5ee49356 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:15.015903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:15.034358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.036167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.130118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:15.167553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 188/376] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:15.169042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:15.173205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bbbb-b3a0-44c7-9628-f4dbc4a7dd18 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:15.261745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:15.263309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.263590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.263861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.264658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:15.264970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.266482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.286031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 189/377] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:15 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:15.334064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04ada7-b1be-4504-ab63-469d6c5ebaff None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:15.383263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:15.383936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.384212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.384485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] PATH_INFO: `/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.385905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] RBAC: Authorizing `identity:get_project(project_id=b9c00e3cb2134915b18b1a5e5538e94a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.387648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.389718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 189/378] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:15 2022] GET /identity/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:15.398732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:15.461842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:15.538668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3d2f-06be-4cef-87a8-360e686b21e9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:15.585775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:15.586742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.587174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.587618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] PATH_INFO: `/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.597321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] RBAC: Authorizing `identity:get_group(group_id=cde8b3c33aab4d2d9263d05db8a6ac88)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.599002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0908-4a0d-4c9d-9d1b-6f44369c6b0e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.600895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 190/379] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:15 2022] GET /identity/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:15.607598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:15.664389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:15.730538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe10ec-1391-4785-b1a5-bcc041e9800c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:15.769527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:15.770162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.770440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.770712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.771506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] RBAC: Adding query filter params (group.id=cde8b3c33aab4d2d9263d05db8a6ac88, role.id=49c473efb0f54f149c348fb507115880, scope.project.id=b9c00e3cb2134915b18b1a5e5538e94a) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:15.771813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:15.773258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2cff0-523e-4b7a-a08d-9709640c2eb0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:15.780295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 190/380] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:15 2022] GET /identity/v3/role_assignments?group.id=cde8b3c33aab4d2d9263d05db8a6ac88&scope.project.id=b9c00e3cb2134915b18b1a5e5538e94a&role.id=49c473efb0f54f149c348fb507115880 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:15.874548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92d7d0-2481-46cf-8b66-3b81a8292d7e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.875521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92d7d0-2481-46cf-8b66-3b81a8292d7e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.876016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92d7d0-2481-46cf-8b66-3b81a8292d7e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.877767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 191/381] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:15.891977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:15.892543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:15.892543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:15.922558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:15.923820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:16.002089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 191/382] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:16.029463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92d7d0-2481-46cf-8b66-3b81a8292d7e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:16.150496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92d7d0-2481-46cf-8b66-3b81a8292d7e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:16.152165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:16.198867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:16.199594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.199933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.200218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.215299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:16.220891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:16.221846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:16.222653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 192/383] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:16.228327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:16.303748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:16.385005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a13348-0ae7-4fe9-89bb-974396abb473 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:16.436014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:16.436647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.436921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.437190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.437933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] RBAC: Adding query filter params (name=member) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:16.438232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:16.439651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:16.453774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 192/384] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:16.459059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:16.599981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2da8a-28e2-4d3e-bc37-6dac0d7f9198 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:16.645078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:16.645756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.646042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.646320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.648861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:16.650344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:16.652827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 193/385] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:16 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:16.658346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:16.810748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:16.813739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaee411-9cdc-4db0-9ad9-60496ed25534 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:16.855378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:16.856028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.856311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.856587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.857797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:16.859274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9a93-6510-44f1-b619-c6d400898078 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:16.860942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 193/386] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:16 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:16.866705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:16.877112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890527e-674c-4c00-a696-b92e578b1709 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.877462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890527e-674c-4c00-a696-b92e578b1709 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.877689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890527e-674c-4c00-a696-b92e578b1709 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.881656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 194/387] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:16.888505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328951a9-7622-41ca-819e-4f34de680328 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:16.888825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328951a9-7622-41ca-819e-4f34de680328 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:16.889053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328951a9-7622-41ca-819e-4f34de680328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:16.917767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:16.924273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-328951a9-7622-41ca-819e-4f34de680328 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:16.925481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-328951a9-7622-41ca-819e-4f34de680328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:17.043902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 195/388] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:17.060436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760caa73-3aca-4547-8b07-c3179d4d138b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:17.088167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328951a9-7622-41ca-819e-4f34de680328 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:17.124221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:17.124914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:17.125197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:17.125491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/groups/657cddd22b914c169af0e0735cd6762a/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:17.131711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, group_id=657cddd22b914c169af0e0735cd6762a, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:17.133245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:17.161093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 194/389] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Jul 29 11:33:16 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/groups/657cddd22b914c169af0e0735cd6762a/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:17.226236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:17.230334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328951a9-7622-41ca-819e-4f34de680328 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:17.273116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:17.273811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:17.274090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:17.274356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:17.291361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:17.296637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:17.297631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:17.298416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 196/390] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:17.304140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:17.421175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:17.434136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b255f2-454b-45d5-afcc-455212921905 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:17.471995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:17.472631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:17.472919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:17.473198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:17.473947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:17.474254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:17.475644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:17.485908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 195/391] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:17.491769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:17.667828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509dd9-9ff0-48b6-800f-6a9973b4841f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:17.715446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:17.716105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:17.716388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:17.716663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:17.717861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:17.719310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:17.721212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 197/392] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:17 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:17.726866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:17.864323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051d485-9c24-4834-87ef-7bec21054a48 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:17.904514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:17.905179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:17.905480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:17.905765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:17.906966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:17.908412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06088bee-71d0-4880-9afd-2cc6496b3bfa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:17.910338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 196/393] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:17 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:17.916265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:17.951285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.031439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334380d3-1f51-4b4b-b4d6-f6b8cdc24628 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.076515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.078102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.078866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.079598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f/groups/657cddd22b914c169af0e0735cd6762a/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.088241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed50bad29524f778785a3e24c00ef0f, group_id=657cddd22b914c169af0e0735cd6762a, role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:18.090632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d48c2-13e3-47f1-b8b0-c8b906039928 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:18.111747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 198/394] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Jul 29 11:33:17 2022] PUT /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f/groups/657cddd22b914c169af0e0735cd6762a/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:18.138131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99ab0-a080-4877-8626-f8b37ea07fc4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.138674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99ab0-a080-4877-8626-f8b37ea07fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.138674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99ab0-a080-4877-8626-f8b37ea07fc4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.140345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 197/395] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:18.145982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed451c-bb51-4338-ab97-d29727ad5014 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.146284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed451c-bb51-4338-ab97-d29727ad5014 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.146533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed451c-bb51-4338-ab97-d29727ad5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.146628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121bb4-90d7-4255-95bb-c99411aa0eb0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.146821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121bb4-90d7-4255-95bb-c99411aa0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.147098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121bb4-90d7-4255-95bb-c99411aa0eb0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.148815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 199/396] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:18.150080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e848d9-a67b-4b93-9c98-9f91aca7328d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.150457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e848d9-a67b-4b93-9c98-9f91aca7328d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.150797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e848d9-a67b-4b93-9c98-9f91aca7328d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.152951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 200/397] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:18.156092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.156406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.156791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.175362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-56ed451c-bb51-4338-ab97-d29727ad5014 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:18.176370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:18.176668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-56ed451c-bb51-4338-ab97-d29727ad5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:18.177558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:18.193228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.256597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 198/398] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:18.257507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 201/399] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:18.258255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.258653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.259032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.278566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:18.279996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:18.280898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.305139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.367134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 199/400] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:18.368713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.393467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52131-11c9-4a32-b2be-83e77951a756 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.430081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.430880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.431266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.431653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.442894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:18.449456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:18.450518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:18.451567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:18.453651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 202/401] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:18.454634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.473963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.502147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec3d78-c6ee-4981-9e3e-fb34af46c26e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.547274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.548456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.548886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.549310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.561837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.563661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:18.566369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf286-0028-408e-9b11-e4ddcbcf6599 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:18.570203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:18.571070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:18.571861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:18.573774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 200/402] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:18.574721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.607278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.608127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.608570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.608945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.621372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:18.627034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:18.628037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:18.628820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:18.629608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 203/403] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:18.631012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.714015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06224-e619-47bb-99fd-e4a1767c826d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.760053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.761993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.762447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.763175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.764313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:18.764788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:18.766020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8191ba-262d-414a-8664-8ff3fab2deb3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.766495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:18.777110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 201/404] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:18.778587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.782493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.815260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.816186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.816667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.817484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.818905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:18.819417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:18.821956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:18.825657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:18.837491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 204/405] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:18.838581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:18.915580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e124e-0dad-48e0-a102-a548210fbf60 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.963602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:18.965042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:18.965499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:18.966388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:18.967748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:18.968479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:18.970736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:18.982009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf9e08-d258-4536-b8d4-d18c125fad8a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:18.984304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 202/406] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:18.985225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.020714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.021806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.022315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.022817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.024281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.026115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.028326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 205/407] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.029514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.051338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.093163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc853-9226-48e0-b522-997ce2dbf55a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.101775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.130121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.130833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.131118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.131374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] PATH_INFO: `/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.132548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] RBAC: Authorizing `identity:get_group(group_id=cde8b3c33aab4d2d9263d05db8a6ac88)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.134164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.140456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 203/408] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:18 2022] GET /identity/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.141323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.144849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6bd03-54a5-4c44-a910-be1f319f0682 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.180989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.182036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.183084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.183566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.185033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.186706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.188866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 206/409] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:19 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.189983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.259916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2a2b-43e2-4be7-b4ab-4fa94971635a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.291148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.302612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.303522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.303910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.304523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.305865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.307942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.310281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 204/410] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:19 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.311393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.314183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd901-7564-4be2-8188-7da11ae113a8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.356817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.358041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.358540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.359189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] PATH_INFO: `/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.361468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9c00e3cb2134915b18b1a5e5538e94a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.363135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.370784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 207/411] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:19 2022] GET /identity/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.370784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.375120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.449275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d883-970b-4902-b275-d2a2415a3df2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.492232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.492907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.493187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.493497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.495058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.496571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.498397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 205/412] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:19 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:19.499257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.509050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63e499-4786-4da0-88d1-1f9b4bbd97b0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.545101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.546246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.546796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.547309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/groups/657cddd22b914c169af0e0735cd6762a/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.549781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, group_id=657cddd22b914c169af0e0735cd6762a, role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.551501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.576814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 208/413] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Jul 29 11:33:19 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/groups/657cddd22b914c169af0e0735cd6762a/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:19.576814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.582511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.638689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59bc70-97e5-480e-b9e1-18014cc04ef8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.675692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:19.682139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.683707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.684657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.685476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] PATH_INFO: `/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a/groups/cde8b3c33aab4d2d9263d05db8a6ac88/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.687707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] RBAC: Authorizing `identity:create_grant(project_id=b9c00e3cb2134915b18b1a5e5538e94a, group_id=cde8b3c33aab4d2d9263d05db8a6ac88, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.689453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857489a3-220c-495d-b2ec-6a2356378eaa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.705333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 206/414] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Jul 29 11:33:19 2022] PUT /identity/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a/groups/cde8b3c33aab4d2d9263d05db8a6ac88/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:19.706895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8259-7471-46b0-adb7-8520c5d6f1c8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.707204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8259-7471-46b0-adb7-8520c5d6f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.707528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8259-7471-46b0-adb7-8520c5d6f1c8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.709242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 207/415] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:19.716220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.716618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.716894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.727761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce350d1-3876-410f-b22b-b0f72e43cb34 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:19.739223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:19.740453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:19.770907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:19.771597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:19.771881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:19.772160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/groups/657cddd22b914c169af0e0735cd6762a/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:19.775064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e02380bb69743c89a9e7a09487cfd5b, group_id=657cddd22b914c169af0e0735cd6762a, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:19.777512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:19.802786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 209/416] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Jul 29 11:33:19 2022] PUT /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b/groups/657cddd22b914c169af0e0735cd6762a/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:19.847460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 208/417] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:19.868802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:19.991887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3c66-6613-4f79-b714-9d5d7c89d97a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:20.016983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:20.033511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:20.034165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.034448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.034723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.046009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:20.053679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:20.054551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:20.055342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:20.060405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 210/418] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:20.061813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:20.126880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:20.172087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb49a-c523-4198-a12e-3e5b42a91f00 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:20.208168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:20.208849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.209135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.209407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.210156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:20.210466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:20.211863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e178-9058-43e1-8128-61baae880365 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:20.225560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 209/419] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:20.227579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:20.335800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ceda2-ddee-42da-b441-4dd9dfecd6b9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:20.372686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:20.373316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.373654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.373933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.426923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:20.447347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:20.449671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:20.495162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65f7d-02a9-47ad-b4e3-2849a7215b96 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.495507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65f7d-02a9-47ad-b4e3-2849a7215b96 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.495799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65f7d-02a9-47ad-b4e3-2849a7215b96 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.497142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 210/420] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:20.503765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.504310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.504791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.529127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:20.530686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:20.593524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 211/421] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:20.598973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:20.616077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 211/422] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:20.644448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:20.725772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:20.758666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:20.791420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff606-4572-4afe-b274-abe93bd1d52b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:20.824317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddeb22-3e3c-49c8-a5bf-5eac51b44f12 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:20.864841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:20.865429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.865713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.866079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.876537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:20.881543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:20.882415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:20.883207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:20.883826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:20.883919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 212/423] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:20.883996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:20.883996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:20.883996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:20.889682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:20.890140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:20.891601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:20.893559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 212/424] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:20.906059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:21.060866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435406df-0f29-4970-bff9-a56c9fab8792 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.089829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:21.108962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276796f8-51ac-4e00-bc04-79aece1d9faf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.133336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.133983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.134260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.136389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:21.137377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:21.137707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:21.140783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:21.158509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 213/425] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:21.164522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:21.192789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.193865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.194142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.194413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:21.197671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:21.202266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:21.205442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 213/426] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:20 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:21.212709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:21.236742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:21.331717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6de40-8024-4f6a-9232-a664d1d6d88e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.371690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.372458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.372742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.373019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:21.373843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=2ed50bad29524f778785a3e24c00ef0f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:21.374179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:21.376174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:21.382738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 214/427] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:21 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=1bee8395f89b42498b722eee5ee49356 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:21.407060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ccb5-3a61-4ecb-ac2d-73f36546a3f6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.448593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.449498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.449785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.450060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:21.503766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:21.542142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:21.543640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:21.653473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 214/428] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 11:33:21.658777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:21.765471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:21.786052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0823a-eac7-4384-ad99-28dd00089525 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.820753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.821402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.821716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.821993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] PATH_INFO: `/v3/projects/2ed50bad29524f778785a3e24c00ef0f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:21.823288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] RBAC: Authorizing `identity:get_project(project_id=2ed50bad29524f778785a3e24c00ef0f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:21.824915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:21.828924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 215/429] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:21 2022] GET /identity/v3/projects/2ed50bad29524f778785a3e24c00ef0f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:21.834418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:21.922768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:21.957693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f5067-4c32-4351-bcf4-18c274da85a9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:21.998230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:21.998889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:21.999173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:21.999453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.000630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:22.002155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40976071-800c-4c42-b7e8-16e32ccec610 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:22.004088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 215/430] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:21 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:22.010009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.103067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b89ba-f1b8-4007-b142-090ec85cb89a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.103382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b89ba-f1b8-4007-b142-090ec85cb89a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.103931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b89ba-f1b8-4007-b142-090ec85cb89a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.107009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 216/431] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:22.112891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.113318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.113627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.133051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d448c-25af-419a-8d9f-65160ea28f0d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.136262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:22.138603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:22.192198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.192965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.193319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.193701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.194570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=2ed50bad29524f778785a3e24c00ef0f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:22.194952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:22.196462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9757cf-beb5-4c53-844a-c9404d1d398a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:22.204462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 216/432] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=2ed50bad29524f778785a3e24c00ef0f&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:22.206295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a435-601a-4b0b-ac65-c6163624a826 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.206666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a435-601a-4b0b-ac65-c6163624a826 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.207026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a435-601a-4b0b-ac65-c6163624a826 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.208429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 217/433] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:22.216456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5420-0521-4156-984c-6eadeb87c31e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.216456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5420-0521-4156-984c-6eadeb87c31e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.216456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5420-0521-4156-984c-6eadeb87c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.234931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c4ca5420-0521-4156-984c-6eadeb87c31e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:22.236213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c4ca5420-0521-4156-984c-6eadeb87c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:22.241362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 217/434] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:22.249828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.266596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.322658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 218/435] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:22.324055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208cc2-d5ed-45e4-aad5-e03a775c5166 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.324421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208cc2-d5ed-45e4-aad5-e03a775c5166 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.324706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208cc2-d5ed-45e4-aad5-e03a775c5166 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.326435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 219/436] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:22.331622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.331907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.332184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.351257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:22.352536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:22.358906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.401499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7f54-6953-4301-a2eb-b7ee605769af None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.438692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 220/437] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:22.439550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.447464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.448792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.449074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.449352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.459767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:22.465297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:22.466217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:22.466989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 218/438] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:22.467627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.537690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.566001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6cecf-b65f-4b70-b5e5-b6773d28ced3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.597198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b61-7a01-4da0-913e-194becd69568 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.610317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.610966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.611251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.611533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.625725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:22.630155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:22.631842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:22.632741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:22.633555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 221/439] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:22.634208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.639277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.640126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.640413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.640692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.651086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:22.656100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:22.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:22.657789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 219/440] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:22.658440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.737245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411d66-60ef-42a4-9eaa-88b033d99894 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.757746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017dde-9226-4ccb-a5c1-6bb8e6b6875c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.772093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.772711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.772995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.773265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.774101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:22.774314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:22.775697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:22.777222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.784502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 222/441] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:22.785295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.792082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.792699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.792979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.793248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.793988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:22.794299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:22.795655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:22.803748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 220/442] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:22.804656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.857133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:22.889427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebbe1b-032d-406b-b61e-7188939b2a6c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.904693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab7f4d-b17c-4d51-b25f-af5780a1d863 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:22.921726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.922332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.922610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.922882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.923582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:22.923883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:22.925260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:22.933802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 223/443] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:22.934622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:22.943231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:22.943866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:22.944146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:22.944423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:22.991315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.013239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.014747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.034275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d224a-bd0b-44bb-b024-a97464baea3a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.066686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.066945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.067559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.067835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.068106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.115600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 221/444] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:23.116436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.135593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.137356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.198813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.217872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e1c8-6a39-4bdf-ad37-7a75f2983406 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.240762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 224/445] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:23.241682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.266284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.266879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.267160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.267424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.288413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.337426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.339044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.340376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57fb07-6ad3-4c21-976a-2df25396b9e2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.373340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.374003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.374280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.374551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.375704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.377139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.378815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 225/446] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.379567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.405933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.442315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 222/447] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:23.443149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.480980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26e356-fcd4-4b36-9abc-461bdb4b6720 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.495403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.515015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.515648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.515933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.516209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] PATH_INFO: `/v3/projects/9e02380bb69743c89a9e7a09487cfd5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.517359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=9e02380bb69743c89a9e7a09487cfd5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.518832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.520489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 226/448] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/projects/9e02380bb69743c89a9e7a09487cfd5b => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.521251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.543232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c37b0-8ba8-47b3-93e6-41c305d30b93 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.576411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.577051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.577327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.577626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.578754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.580189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.581821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 223/449] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.582546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.613339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.620595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06003f-ebf2-4c8a-b5da-24dae55c9ed6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.653583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.654215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.654493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.654761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] PATH_INFO: `/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.655909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] RBAC: Authorizing `identity:get_project(project_id=b9c00e3cb2134915b18b1a5e5538e94a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.657338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.663798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 227/450] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/projects/b9c00e3cb2134915b18b1a5e5538e94a => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.663798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.681649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcffa63-2ddd-4a8a-b22a-d8f925de8b14 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.702450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.716882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.717547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.717822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.718092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] PATH_INFO: `/v3/groups/657cddd22b914c169af0e0735cd6762a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.719226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] RBAC: Authorizing `identity:get_group(group_id=657cddd22b914c169af0e0735cd6762a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.720636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.722231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 224/451] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/groups/657cddd22b914c169af0e0735cd6762a => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.722979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.763559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190de17f-5d4d-43db-a61a-5f03d2c23b8e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.797152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.797800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.798081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.798350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.799127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:23.799432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.800858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.806477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 228/452] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.807371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.836951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93477-25d1-4f3d-9819-6da3b922883a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.837745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.876162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.876837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.877123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.877393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] PATH_INFO: `/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.878688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] RBAC: Authorizing `identity:get_group(group_id=cde8b3c33aab4d2d9263d05db8a6ac88)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.880150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.882082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 225/453] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/groups/cde8b3c33aab4d2d9263d05db8a6ac88 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:23.888352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:23.924977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d082-eabe-4d05-acec-f3e422431e15 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:23.951398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:23.962299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:23.963246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:23.964214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:23.964490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:23.965285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] RBAC: Adding query filter params (group.id=657cddd22b914c169af0e0735cd6762a, role.id=1bee8395f89b42498b722eee5ee49356, scope.project.id=9e02380bb69743c89a9e7a09487cfd5b) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:23.965640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:23.967233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba437d-cc3a-4139-9224-c3bf6e98ad66 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:23.973512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 229/454] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/role_assignments?group.id=657cddd22b914c169af0e0735cd6762a&scope.project.id=9e02380bb69743c89a9e7a09487cfd5b&role.id=1bee8395f89b42498b722eee5ee49356 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:24.005964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125086-5a3b-4c24-b836-afe0f60d81a7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:24.048065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:24.048618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:24.049014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:24.049174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:24.050057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] RBAC: Adding query filter params (group.id=cde8b3c33aab4d2d9263d05db8a6ac88, role.id=49c473efb0f54f149c348fb507115880, scope.project.id=b9c00e3cb2134915b18b1a5e5538e94a) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:24.050367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:24.051826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe56c09-fe07-4804-b95e-2cb5fff65f3c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:24.058956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 226/455] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Jul 29 11:33:23 2022] GET /identity/v3/role_assignments?group.id=cde8b3c33aab4d2d9263d05db8a6ac88&scope.project.id=b9c00e3cb2134915b18b1a5e5538e94a&role.id=49c473efb0f54f149c348fb507115880 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:26.603384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374db5-b5fb-40a8-ba84-c811c5cbaa45 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:26.603872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374db5-b5fb-40a8-ba84-c811c5cbaa45 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:26.603872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374db5-b5fb-40a8-ba84-c811c5cbaa45 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:26.605737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 230/456] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:26.611124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9504b2-f5d1-4522-a531-34fca25a0099 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:26.611544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9504b2-f5d1-4522-a531-34fca25a0099 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:26.611684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9504b2-f5d1-4522-a531-34fca25a0099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:26.630071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3d9504b2-f5d1-4522-a531-34fca25a0099 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:26.631249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3d9504b2-f5d1-4522-a531-34fca25a0099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:26.712709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:26.736939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374db5-b5fb-40a8-ba84-c811c5cbaa45 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:26.856172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87ad9-8885-45fe-a11c-b3b1ea9a6fc4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:26.856774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87ad9-8885-45fe-a11c-b3b1ea9a6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:26.857029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:26.857837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87ad9-8885-45fe-a11c-b3b1ea9a6fc4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:26.860795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 228/458] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:26.865689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:26.866194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:26.866672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:26.867841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374db5-b5fb-40a8-ba84-c811c5cbaa45 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:26.905256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:26.906506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:26.912309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:26.912952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:26.913228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:26.913517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:26.926154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:26.927605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:26.945284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:26.946183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:26.947447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:26.947447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:26.947447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:26.947447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:26.947447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 231/459] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:26.954886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:26.993804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.026771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 229/460] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:27.049529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.124005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2894beb-6983-4ed4-b606-6e1a106751bc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.168710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.170354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.170839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.171546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.173013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:27.177689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.179144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a9a9d-89eb-47e5-b7c1-52ecf4bb9333 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.192704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d735f34-8dd8-4ac0-8f98-4799dfaacba1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.199353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 232/461] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:27.200658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36d22-86a7-4ba7-8655-f5314d9e7042 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.200948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36d22-86a7-4ba7-8655-f5314d9e7042 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.201227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36d22-86a7-4ba7-8655-f5314d9e7042 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.202730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 233/462] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:27.204450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36d22-86a7-4ba7-8655-f5314d9e7042 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.207861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.236742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.237393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.237704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.237979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.248946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.250458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9f1beed9-33ac-42fd-9967-630d9d2ab93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:27.267051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:27.267966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:27.269220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:27.269220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:27.269220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:27.269220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:27.269220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 230/463] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:27.270646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.270646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.270646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.291079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:27.292359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:27.326491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.342665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36d22-86a7-4ba7-8655-f5314d9e7042 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.381582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 231/464] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:27.382434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.399296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.399975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.400259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.400533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.402387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.406218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.438322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 234/465] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:27 2022] POST /identity/v3/users => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:27.439309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.524659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adba4cd-bb81-49e4-8275-51d38fd81601 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.555506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.572226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.573278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.573646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.573833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.574891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:27.575211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.577447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12980-be2c-4d0f-9173-9e24cf3bb49b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.603467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 232/466] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:27.603467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9683-0b22-4ab1-b9e3-0d525f4138a9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.603467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9683-0b22-4ab1-b9e3-0d525f4138a9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.603467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9683-0b22-4ab1-b9e3-0d525f4138a9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.603467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 233/467] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:27.610127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.610765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.611282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.632193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7ee6-904c-4b90-930a-aa475c94f3ac None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.636836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:27.638332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:27.662616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.675032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.675674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.675957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.676237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.689850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.691441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:27.708269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:27.709171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:27.710037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:27.710037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:27.710037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:27.710037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:27.711445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 235/468] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:27.712430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.728531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 234/469] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:27.729512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.833195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0028b3-ff93-4a64-8546-0c2740ab000c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.845822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:27.863950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0723466-2e70-4bf1-836b-603bcf8b9a12 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:27.873790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.874508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.874863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.875214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.876060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.877666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.904082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:27.904280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 236/470] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:27 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:27.904926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:27.905108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.905204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:27.905552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:27.906266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:27.906646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:27.908110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:27.922486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 235/471] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:27.928210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:27.948558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.044069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda43e1f-ee98-4426-8de9-9ca36587bf8f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.071138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435396b-0fce-427a-a762-e73cb5a45c27 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.096985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.097683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.097968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.098517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.111234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.112027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.112405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.112780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.113605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.115408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.115533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60528-2038-4e28-8be6-c8ef3585e118 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.116976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:28.136889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:28.138731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:28.141017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:28.141017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:28.141017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:28.141017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:28.141017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 237/472] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:28.144579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:28.163123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 236/473] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:27 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:28.179335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.270820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e7af-7b9f-4abf-8aef-52d0891feadc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.271178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e7af-7b9f-4abf-8aef-52d0891feadc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.271378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e7af-7b9f-4abf-8aef-52d0891feadc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.273084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 237/474] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:28.279377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.279735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.280082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.287248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894d305-09ed-4e81-9aff-f2bd8fe07641 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.304069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:28.305319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:28.341967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.342616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.343154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.343431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.344637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:28.344941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.346727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.372591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 238/475] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:28.379300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:28.399534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.409605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 238/476] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:28.435408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:28.466406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.490035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4aa59-ee5a-4c32-b0a1-c124ea106573 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.525351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.526536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.526956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.527436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.528140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.529679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.553198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f80b4-1381-4eb7-983b-efae70339954 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.553936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:28 2022] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:28.595422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.596072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.596397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.596675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.597399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.598914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.608866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 11:33:28.608866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 11:33:28.608866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [parameters: {'id': 'b8a9eafc0abf4ba7845189b8e6e55d69', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 11:33:28.608866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:33:28.627197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return ref.to_dict() Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:33:28.629835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 11:33:28.632146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 11:33:28.636920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:33:28.641268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:33:28.643271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'id': 'b8a9eafc0abf4ba7845189b8e6e55d69', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:28.645195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 11:33:28.647160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:28.649121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 239/478] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Jul 29 11:33:28 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:28.649255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:28.753938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb585f-f1c6-49fb-9155-7ca1d872df87 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.789404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.790178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.790464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.790788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.793339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.804216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-25cea0bc-4f50-4d78-9ef0-0f3d6940366b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:28.810563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:28.811653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 11:33:28.812679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:28.814264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:33:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:28.819365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:28.889946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:28.935696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea194-f9e8-48cf-bc03-205af6b9bcef None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:28.973620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:28.974252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:28.974550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:28.974861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:28.975577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:28.975931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:28.977362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5bd4f-9fc5-46b9-88e5-078f12c3327f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:28.987002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 240/480] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:29.901010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0ecf-fc1d-40de-b20c-5c10347b0762 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:29.901551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0ecf-fc1d-40de-b20c-5c10347b0762 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:29.901626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0ecf-fc1d-40de-b20c-5c10347b0762 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:29.903564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 241/481] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:29.909213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:29.909742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:29.909819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:29.933267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:29.934497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:30.021484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 241/482] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:30.056113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af0ecf-fc1d-40de-b20c-5c10347b0762 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:30.196309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af0ecf-fc1d-40de-b20c-5c10347b0762 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:30.245243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:30.245927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.246213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.246492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.271721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a2afb1e2-1718-47b5-98b0-fec3ac930a3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:30.282676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:30.284400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:30.286524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 242/483] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:30.295429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:30.437145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:30.546883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71892f74-de8c-4c51-a3e4-b1d7bfd6eebf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:30.549738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37721-d608-43b1-946d-efe40acf9199 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.550218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37721-d608-43b1-946d-efe40acf9199 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.550701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37721-d608-43b1-946d-efe40acf9199 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.553407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 243/484] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:30.558672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.559176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.559644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.585333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:30.587692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:30.614892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:30.615644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.615928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.616199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.625449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:30.625449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:30.625449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:30.627857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 242/485] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:30.638367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:30.697023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 244/486] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:30.701459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:30.722174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:30.877780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d042-6825-4c06-9a0e-89beae1998b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:30.879831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186cc9a-0d8d-4965-942b-5fd1a353ce24 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:30.911075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:30.943939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:30.946132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:30.946969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.947436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:30.947978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.948438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:30.949185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.949344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:30.968485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:30.970046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:30.974832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:30.977183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:30.978081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:30.978854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:30.982487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 245/487] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:30.993109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:31.011035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:31.012008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:31.013089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:31.013089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:31.013089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:31.013089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:31.014978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 243/488] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:31.023308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.045231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:31.228266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540ec3-6905-48f8-8125-da167d5ce665 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.316886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.318365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.319426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.320335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.321946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:31.323707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.327469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.343855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2bc1-4db2-47b4-88cb-7f344a1ee866 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.348318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 246/489] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:31.356242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.415364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.416000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.416298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.416634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.417877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:31.418314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.419968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.447256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 244/490] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:31.454563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.509894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:31.535570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86e40-0c66-4bd8-bb42-9b91ac3aa735 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.548181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:31.580195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.580945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.581219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.581539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.593491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.595058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.597586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9cc9-f19f-4bfc-b688-cdccde4986c8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3449e326-fc25-47f5-9098-a3f50258c781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:31.610514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:31.612368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 247/491] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fcfa6-7c70-4a53-85d1-1da09dc93905 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fcfa6-7c70-4a53-85d1-1da09dc93905 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.614381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fcfa6-7c70-4a53-85d1-1da09dc93905 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.619444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 248/492] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:31.620592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fcfa6-7c70-4a53-85d1-1da09dc93905 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.642920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.643769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.644165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.644639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.653682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.655396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f5b81659-4b90-4fda-a68e-655f732e9608 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:31.670217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:31.672229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:31.674931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 245/493] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:31.682847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.682847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.682847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.695746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:31.696978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:31.729502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fcfa6-7c70-4a53-85d1-1da09dc93905 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.765868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.766480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.766757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.767028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.767812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:31.768114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.769618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.773569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 246/494] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:31.774479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.782975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 249/495] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:31.788320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.794944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:31.809814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:31.896226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f29a2-4c50-4a3a-a950-53d082ea18ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.896805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27195a7-0e56-498c-9783-cb1dd505ca6a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:31.932058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.932768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.932869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:31.933282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.933282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.933459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.933685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.933954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.934746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:31.935048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.936466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50e4a4-f331-49d6-9ae1-ddcac491109c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.940578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:31.942078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:31.955616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:31.956898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 250/496] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:31.958273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:31.973971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 247/497] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:31.975216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48277e-9b2b-4952-aa51-1a4ca0b19b8a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.975498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48277e-9b2b-4952-aa51-1a4ca0b19b8a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.975769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48277e-9b2b-4952-aa51-1a4ca0b19b8a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.976954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 248/498] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:31.978057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ac572-69b9-4aac-ab87-7d0685c9c7b3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:31.978526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ac572-69b9-4aac-ab87-7d0685c9c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:31.978634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ac572-69b9-4aac-ab87-7d0685c9c7b3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:31.980130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 249/499] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:31.980762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ac572-69b9-4aac-ab87-7d0685c9c7b3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.044492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.058495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.066527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33f32-0446-49b1-9be6-f1433f335f3d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.082086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ac572-69b9-4aac-ab87-7d0685c9c7b3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.099725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.100357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.100635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.100900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.111259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:32.116096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:32.116523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:32.117386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:32.118333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:32.118926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.118926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.118926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.119108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 251/500] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:32.119171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:32.119171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.119300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.119938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c4b4-0613-426a-904d-fb8e9cdd96d9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.139762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 250/501] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:32.140977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b40e-7662-4098-9792-1bbef13724b9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.141266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b40e-7662-4098-9792-1bbef13724b9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.141576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b40e-7662-4098-9792-1bbef13724b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.158911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9743b40e-7662-4098-9792-1bbef13724b9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:32.160096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9743b40e-7662-4098-9792-1bbef13724b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:32.222186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24f6e-ad49-4010-bb38-5016b7cef5d2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.229350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 251/502] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:32.231618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.231845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.232121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.249932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:32.251086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:32.257803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.258429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.258707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.258979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.268968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.310421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.319413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 252/503] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:32.320212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.335278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.336768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.419442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452aa56-335e-49aa-92dc-b9556c81ec56 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.435872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 252/504] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:32.436544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.458091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.458715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.459000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.459277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.459983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:32.460288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.461695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.469654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 253/505] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:32.470588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.476306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.531098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.545874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce4da2-b853-474b-b8f1-e31a722a5235 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.580911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae41fc-ec80-46fe-87e6-28256202fb10 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.584458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.585250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.585704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.586126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.625360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.626301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.626731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.627157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.641611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:32.649826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:32.650901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:32.651742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:32.653925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 254/506] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:32.654873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.665064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.667124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.704818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.766620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3b23-6c47-42e0-a889-9155c2f1d9d1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.784860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 253/507] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:32.785703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.786484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.807741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.808390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.808674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.808952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.820155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.821687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:32.835874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:32.836720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:32.837881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:32.837881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:32.837881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:32.837881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:32.837881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 255/508] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:32.838290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.889054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ccaa-8c12-4f5c-bb15-7419f92c32df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.922628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.923258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.923535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.923806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.930183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:32.934423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.935887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:32.937549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee0b3-ef33-41c6-bad9-7c2563b029e6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:32.950376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:32.951257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:32.952101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:32.952101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:32.952101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:32.952101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:32.952101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 254/509] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:32.952363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:32.975182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:32.976048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:32.976333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:32.976607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:32.987407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:32.988842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:33.002915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:33.003732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:33.004558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:33.004558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:33.004558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.004558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:33.004558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 256/510] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:33.004820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.029941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.052565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2561-90ad-40f4-915c-3d5c24ca126a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.085287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.085926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.086205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.086483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.087191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.087491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.089406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.097078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 255/511] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.097891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.109863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d89b2-ddfa-42b9-9f28-acc4fb98c572 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.143641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.144283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.144564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.144839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.150102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.155840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.157295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:33.171366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:33.172378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 257/512] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:33.177954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.200283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b432c6-1480-432e-84d0-0fc020f40ad9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.233225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.233875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.234147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.234419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.235105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.235403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.236763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.248064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 256/513] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.248850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.253927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.284873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3daa-40e9-415a-87c6-2376b4d48bbe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.317141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.317718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.318000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.318275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.318962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.319266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.320628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.332738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 258/514] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.333574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.348466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cc36-0fc5-4e5c-b88d-90867f7a404b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.362259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.383679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.384304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.384587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.384867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.386238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.386546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.388200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.399265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 257/515] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.400058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.440446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5d385-a105-4981-ab73-f9d63f0562a7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.470662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.475654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.476291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.476572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.476850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.487440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.488899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.500113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cd7a1-5c9e-4906-a8ee-c10ff0b91f4d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:33.503466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:33.504454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 259/516] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:33.510195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.536347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.536959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.537242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.537539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.538223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.538525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.539896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.551559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 258/517] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.552431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.582940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.609245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947e32-215e-4bfc-9ed9-af64491953f6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.643214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.644078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.644359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.644639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.645312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.646772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.650716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356b2b-e85c-4cac-8802-bf3bdecd428f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.666714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 260/518] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:33 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:33.667827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.701747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.702501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.702851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.703197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.710722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.712281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.715475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:33.726492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:33.727625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:33.728680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:33.735052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 259/519] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:33.735052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.794659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af96c-00e2-4f7a-abdf-c93cea5f4e3b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.837363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.837555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.838119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.838439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.838720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.846951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.848006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b167-b86a-43d5-9024-f93554feb599 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:33.848408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:33.860275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:33.861477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 261/520] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:33.862595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.894488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:33.895097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:33.895370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:33.895639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:33.896432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:33.897055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:33.898231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:33.913465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 260/521] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:33.913465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:33.978321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:33.983575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783de1ff-b0ac-4eb4-9c8c-16d530fb6669 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.018935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142325-130f-4cd7-ba79-2ea90ba243b5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.020305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.020957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.021243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.021556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.028949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.030434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:34.043430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:34.044480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:34.045326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 262/522] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:34.045819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.065726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.067178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.067786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.068234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.069508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.069956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.072105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.094620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 261/523] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.095937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.111032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.160750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b124b-f65a-47fc-9051-a15d39659f57 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.200981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.201690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.201976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.202247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.203040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.203345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.204782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.216377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260917e0-7e7f-494a-9b1b-88f225c3b2eb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.227825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 263/524] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.227825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.249122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.253533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.254187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.254445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.254718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.262549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.264078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:34.275767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:34.277471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 262/525] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:34.278352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.350236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50212c-aa0f-4b2d-b360-587f691830f4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.355295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.386530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea77fd-3c23-42e3-a72c-e5bf30042c81 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.388229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.388868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.389930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.389930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.390214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.390482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.391915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.410573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 264/526] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.411455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.429956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.430713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.431002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.431274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.432083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.432431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.434015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.439440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 263/527] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.440236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.515037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.546353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505de1-d664-418f-995a-61ba113f5ba7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.580624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8e60d-a6eb-4191-827a-dcc2fe866ca9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.587807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.589336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.589972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.590521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.620436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.621078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.621363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.621680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.622481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.622789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.624379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.636408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.663522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 264/528] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.664381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.676113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.677766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.772047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba6c2-77c2-483d-a384-4bc6bfa34ca0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.777761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.810761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 265/529] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:34.811907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.812022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.812642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.812911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.813191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:34.814023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=6bfc7686898b406bb89f9f0280308004) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:34.814335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:34.816111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:34.824620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 265/530] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/role_assignments?user.id=6bfc7686898b406bb89f9f0280308004&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:34.825491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:34.898307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:34.948990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9e57e-d7cb-4909-ad78-51b19c5036e4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.960803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcf57c-db03-4924-b6b4-9c66b644fea9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:34.987250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:34.988012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:34.988363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:34.988697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.002100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.003603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.014651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.015311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.015580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.021438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:35.023734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:35.024553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:35.025598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:35.025598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:35.025598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:35.025598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:35.025598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 266/531] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:35.032462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.070375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.098265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.099856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.194381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba109a-5f7b-473b-9335-b30ce9860380 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.206274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.227112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 266/532] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:35.233520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.243611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.244242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.244526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.245340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.246081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:35.246391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.247773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.267447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 267/533] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:35.278567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.332329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.390762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54eca9-1e32-4478-ac9e-c572ac658cc7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.422945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68d3bd-ef00-4dd3-ae82-f17585731fa7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.447471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.448939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.449403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.449704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.460225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.461165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.461684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.462164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.470302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.472080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.475650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.477125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:35.484815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:35.485717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:35.486543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:35.488914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 268/534] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:35.499260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:35.503492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:35.504321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:35.505169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:35.505169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:35.505169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:35.505169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:35.505813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 267/535] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:35.519049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.542324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.615687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c9fb4-2f05-46ea-9654-599c4df297a4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.690892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.691513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.691795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.692066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.692820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:35.693120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.694590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.707552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e9fa5-b77b-4c77-8c18-b5f20829d32e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.720363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 269/536] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:35.726302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.768590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.775694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.777636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.777926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.778204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.778905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:35.779214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.780609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.810592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 268/537] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:35.818478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:35.878941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:35.893272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6885c-df12-4309-9f77-328cf246ff67 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.936328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:35.937044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.937330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.937628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.938588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=939111fa56304aae981501d7a222b61f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:35.939229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:35.940925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c2c84-e5cf-4a27-9a51-3dace56ae91c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:35.948266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 270/538] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/role_assignments?user.id=939111fa56304aae981501d7a222b61f&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:35.949249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5093-306f-4f71-a526-51f9b6793ab8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:35.949534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dc41-6046-468f-8650-555f4cdc9925 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.949876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dc41-6046-468f-8650-555f4cdc9925 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.950158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dc41-6046-468f-8650-555f4cdc9925 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.955559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 271/539] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:35.957811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:35.958031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:35.958308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:35.982188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:35.983592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:36.023957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.025736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.026580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.026988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.047332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:36.048870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:36.071769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:36.072666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:36.073597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:36.074770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 269/540] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:36.081456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.105437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 272/541] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:36.146969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.165505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:36.249504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e970fa6-483d-454a-83da-e144cf47ce81 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:36.285789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:36.307424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38c4c-65d3-48f4-b462-4744873e5b90 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:36.324258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.324901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.325187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.325479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.326245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:36.326555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:36.328015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:36.356759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 270/542] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:36.363270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.382303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.383080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.383364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.383637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.403004 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:36.414472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:36.415376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:36.416151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 273/543] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:36.423020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.552359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874167-c3a4-4695-b9b2-c7eb0caf257c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:36.570220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:36.605573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5afb4-0e34-4ed7-a2e9-d02379918a10 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:36.616658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.617289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.617600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.617879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.618670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=3fa4877f580c4c708e7a6946b5f0d0a5) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:36.618985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:36.621277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:36.630648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 271/544] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/role_assignments?user.id=3fa4877f580c4c708e7a6946b5f0d0a5&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:36.657995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.658625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.658963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.659242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.659969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:36.660314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:36.661714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019c509-c36e-4d69-8adb-7d0cf9ceccdc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:36.671538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 274/545] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:36.677103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.759488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd50a0-b409-4ee2-9dfe-703ed5c0dd6c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.759810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd50a0-b409-4ee2-9dfe-703ed5c0dd6c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.760042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd50a0-b409-4ee2-9dfe-703ed5c0dd6c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.763686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 275/546] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:36.768215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.768514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.768788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.794983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:36.800575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:36.801819 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:36.854762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdc182-2633-45cf-ab17-f1d73eb203c0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:36.893690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:36.894452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:36.894808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:36.895159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:36.907921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:36.909532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:36.919552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 276/547] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:36.925191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:36.926040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:36.926865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:36.926865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:36.926865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:36.926865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:36.926865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 272/548] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:36.934874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:36.956704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.004413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.109107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98c5de-f205-4991-946c-4c34df40cd30 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.139549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789cb9-19c7-4f0e-aa71-f2db4a20d81b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.173766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.174397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.174675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.175060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.175764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:37.176065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.177462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.183013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.203300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 277/549] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:37.205403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.236200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.236870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.237397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.237707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.259627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:37.271179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:37.272781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:37.273973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:37.274734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 273/550] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:37.279817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.363828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231632d8-3c50-4570-a3cc-317253945c02 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.406912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.407457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.407620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.407907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.408272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.416622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.418915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.427972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df6fb-9ba5-4fec-a486-ac0013417469 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-14a0634d-d61a-4fad-9678-65ac623ff45a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:37.432043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:37.433050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:37.434167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 278/551] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:37.439413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d07885-ea11-44f1-b57a-5178e327079c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.439705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d07885-ea11-44f1-b57a-5178e327079c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.439982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d07885-ea11-44f1-b57a-5178e327079c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.441465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 279/552] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:37.442020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d07885-ea11-44f1-b57a-5178e327079c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.476103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.477307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.477791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.478215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.479884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:37.480478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.482373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f904-3fdc-4ee2-9e23-986d98a305b1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.493835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 274/553] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:37.495703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.495995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.496401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.506964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.520203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:37.521717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:37.560134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d07885-ea11-44f1-b57a-5178e327079c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.597129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.597535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.597813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.598083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.598985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:37.599328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.600755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.615469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 275/554] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:37.616484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.627941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 280/555] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:37.632991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.722134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.755614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16193-f75b-4eac-a202-b544e9ca9e1b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.756628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bb0b4-ecfd-4a20-9b3b-02b462a0d130 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.771673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.794340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.794953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.795230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.795498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.795650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.796559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.796986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.797432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.808414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.810080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:37.826968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:37.828055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:37.829061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:37.829061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:37.829061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:37.829061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:37.830886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 276/556] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:37.831842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.873720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:37.875148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:37.940740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2e42-4a71-48d4-855a-bf381613fd72 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:37.970752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:37.978244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:37.979749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:37.980482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:37.980941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:37.982263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 281/557] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:37.983220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:37.992717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:37.999310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.000647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:38.001492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:38.002113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.004037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 277/558] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.005067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.097748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2684-e0d4-4b93-b795-a12e43f82426 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.111664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474f75-0b9d-4c68-99b1-1fbfc1904f5c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.134089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.134339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.134578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.134844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.135815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:38.136156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.137777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.151834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.153159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.153649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.154156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.155848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 282/559] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:38.156981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.166995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.168827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:38.193332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.194305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.195165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:38.195165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:38.195165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.195165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:38.197442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 278/560] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.198644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.238890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.244589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.268506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f07159-cb19-42bb-b716-536d57675890 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.305648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.306203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.306485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.306755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.308034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:38.308333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.309748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.309953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d6f4-8334-4385-9d69-09122db1eea8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.324473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 283/561] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:38.325710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.347705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.348646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.349107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.349586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.357852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.359542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:38.371824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.372866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:38.373820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:38.380497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 279/562] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.380497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.436506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d501-8242-4308-8f94-2dacb352a687 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.477100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.477758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.478069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.478347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.479611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:38.480025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.481394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc0077-1e5f-4a5a-a644-f95f8b21d59b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.484491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.486995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d24af-80f7-435b-9eb0-35aad24b42de None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.488637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.501116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 284/563] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:38.502348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463de9-c8ff-4488-91bd-f6c5cb965402 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.502635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463de9-c8ff-4488-91bd-f6c5cb965402 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.502905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463de9-c8ff-4488-91bd-f6c5cb965402 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.508248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 285/564] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:38.509015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463de9-c8ff-4488-91bd-f6c5cb965402 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.525389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.526149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.526436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.526718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.538298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.539742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:38.555360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.556274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.557281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:38.557281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:38.557281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.557281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:38.557281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 280/565] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.558546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.622882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463de9-c8ff-4488-91bd-f6c5cb965402 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.658591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.659203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.659489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.659765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.660554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:38.660763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0f40-16ff-4430-94dd-5640dfd2bb27 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.660873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.662347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8d586-c083-485d-9efd-b52eca76d848 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.685368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 286/566] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:38.685368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.685368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.685368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.696383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.697077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.697368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.697676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.703003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:38.704227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:38.705576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.707554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:38.719675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.720747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 281/567] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.721993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.740958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.761402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.780631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 287/568] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:38.781373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.844771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde54-9c3d-4853-a6e1-55e61830fda4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.878322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.878939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.879223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.879501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.880189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:38.880498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.881908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.886037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7b1df-2270-4d06-a6c6-702324e0e57a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:38.893667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 282/569] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:38.894493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.921459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:38.922172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:38.922454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:38.922730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:38.932765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:38.934249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:38.950058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:38.950924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 288/570] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:38.952025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:38.974924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:38.987922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.002204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f19f55-7574-4db2-8381-817d679e3a8c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.037402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.038057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.038344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.038623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.039363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:39.040005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.041215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d1c3a-ebf8-4520-a21b-99557a63edf8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.052410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e25a-1d7a-4d58-ad47-9175965b1921 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.052986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 283/571] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:39.054263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a318-2595-431d-8a68-d19c255485ba None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.054555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a318-2595-431d-8a68-d19c255485ba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.054833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a318-2595-431d-8a68-d19c255485ba None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.056038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 284/572] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:39.056732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149a318-2595-431d-8a68-d19c255485ba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.092153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.092789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.093066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.093340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.103333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:39.109385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.110329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:39.111145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 289/573] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.112107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.163758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149a318-2595-431d-8a68-d19c255485ba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.196699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.197332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.197638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.198557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.200791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.205227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.207502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.208934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.211426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb377b-6709-4ca6-b355-5d0365d6d2a7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:39.220708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.221857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:39.222799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 285/574] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.223378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.246242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.246860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.247140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.247416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.248107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:39.248414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.249809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5860-9ed8-40ff-afa8-a5698a3b781f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.261829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 290/575] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:39.263378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.263695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.263974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.281615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:39.282822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:39.322185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b00-6677-42d7-adec-6e8d7f5f6d94 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.347708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 291/576] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:39.348536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.355854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.356465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.356742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.357819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=050cd624409b4c269af8805835ec5f53) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:39.358129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.359540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.374297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 286/577] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/role_assignments?user.id=050cd624409b4c269af8805835ec5f53&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:39.374297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.456983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.466542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.485771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f83204-c635-4ea3-8e2e-100ac9b3cedc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.514354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2e17-f216-498a-af67-9384a9347cd4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.524750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.525387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.525699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.526037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.527279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:39.527586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.528955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.541775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 292/578] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:39.541775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.561682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.562516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.562907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.563318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.564573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:39.564888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.566505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.593768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 287/579] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:39.593768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.651123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936351-57e9-4ebc-9e37-ea68e217a51c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.686578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.687226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.687511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.687788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.694729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.696186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.699606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f062a-cd46-4f6a-a30c-1cb65526b6e2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:39.710919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.712015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:39.713125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:39.718985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 293/580] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.719760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.720299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.730649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.741356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.742092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.742382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.742660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.754282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:39.759478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.760466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 288/581] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.766890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.835924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ca91-8e83-4fcb-8c64-cfdb48c62864 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.871857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.872497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.872779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.873056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.876063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd385-e4ba-4240-8f69-703637463a0b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:39.883891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.885964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:39.900702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.902180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.903055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:39.903055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:39.903055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:39.903055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:39.903055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 294/582] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.903755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.915925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:39.916603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:39.917208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:39.917377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:39.927983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:39.929467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:39.945171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:39.946216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:39.947134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:39.947134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:39.947134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:39.947134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:39.947134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 289/583] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:39.948320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:39.975244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:39.978529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.019695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573283-04ec-4e35-adb4-372a5bb784e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.054798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0cd0-ee5b-41d5-b347-8f403a792073 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.055425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.056044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.056322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.056597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.057405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.057740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.059183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.072142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 295/584] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.073675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.097180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.097862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.098158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.098445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.099167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.099478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.100849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.110869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 290/585] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.112055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.178143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83240df3-f785-4b64-956d-ccb336d3455c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.200238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.216428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.217047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.217330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.217666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.218358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.218664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.220040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.227799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.232163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 296/586] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.232950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.245322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbcba3-06fd-42d2-9b7d-dbfef3231d84 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.281912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.282562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.282819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.283095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.283781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.284089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.285479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.298142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 291/587] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.299026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.344985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552194b-a48d-45eb-a51f-e3812898b7a3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.385721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.386409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.386691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.387122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.404430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=a2502e6309ca4a688de48416b09d16c3, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.405923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.408725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d1bc-fc25-4927-94c2-9f30a8e14a3c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.420804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 297/588] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:40 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:40.421781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.459073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.479385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.480737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.481889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.482435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.502273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.504770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:40.529281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:40.530336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:40.532132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:40.532132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:40.532132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:40.532132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:40.534540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 292/589] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:40.535978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.540844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.546338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2fe4b-e933-48a6-9561-ebccc758a390 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.586524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.587337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.587709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.588087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.596298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.598097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:40.612584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:40.613787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:40.614770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:40.618461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 298/590] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:40.618461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.674841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b86e6-0f43-41ee-8ad2-ead922e06f02 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.725861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.726518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.726803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.727490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.737292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.739311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.741935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.753657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa762d-ff28-428e-9b3a-905bb63e7fa9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:40.758296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:40.759337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:40.760962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 293/591] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:40.761465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.794578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.795617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.796152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.796633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.797577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.798121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.799750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.813353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 299/592] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.814612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.851807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:40.910969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23594b63-ad62-4383-b099-dcb64ae8a5db None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.931304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29980-de95-4f7a-a5cb-d7bc1c895f85 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:40.957107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.958187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.958483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.959083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.959636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.959997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.961465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.971334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:40.972340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:40.972834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:40.973308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:40.974285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:40.974813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:40.976472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:40.986434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 294/593] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.986434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:40.993695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 300/594] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:40.994856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.011314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.110495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db172-1c1e-4225-b1b2-fae57e1d6fd6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.112596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276f8-cc6a-41da-9a24-5f754fd2317c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.138216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.153344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.154193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.154582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.154958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.157150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.158329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.158763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.159206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.166784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.168464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.168667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.170293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:41.186066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:41.187237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:41.188423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:41.190849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 295/595] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:41.191768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:41.192174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:41.193077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:41.193982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:41.193982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:41.193982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:41.193982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:41.202722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 301/596] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:41.202722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.286557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.312857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42a703-54ca-46ba-83bd-c6d4e7284fde None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.343773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f29bb-15d1-478f-9ada-76dc3fe2e66e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.349131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.349957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.350394 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.350794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/6bfc7686898b406bb89f9f0280308004/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.366793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=6bfc7686898b406bb89f9f0280308004, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.368256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.385471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 296/597] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:41 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/6bfc7686898b406bb89f9f0280308004/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:41.385471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.389184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.390163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.390585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.390994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.391999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:41.392445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.394931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c716-0d3e-4d58-b888-03dadbf13b86 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.421568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 302/598] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:41.423226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2944-7c25-4e7a-95de-ab5ed80aa21a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.423775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2944-7c25-4e7a-95de-ab5ed80aa21a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.424214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2944-7c25-4e7a-95de-ab5ed80aa21a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.425870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 303/599] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:41.428578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2944-7c25-4e7a-95de-ab5ed80aa21a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.431760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.527816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05afe3a-35ca-4919-82d9-b5a4030d8942 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.561278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2944-7c25-4e7a-95de-ab5ed80aa21a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.570319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.571210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.571656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.572090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.573563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:41.574028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.575564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504aff-7c9d-41d7-8529-4b2c3cfb9562 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.588342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 297/600] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:41.589475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.590796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.591281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.591706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.608109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.608763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.609047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.609324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.615357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:41.617400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:41.620715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.622264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:41.638696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:41.639621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:41.640772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:41.640772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:41.640772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:41.640772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:41.640772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 304/601] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:41.641117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.721439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 298/602] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:41.721439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.745318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.815505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e643e8-85f5-49f3-872e-15a2694e5db8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.846373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6706-f715-43e1-b2e9-b2ca56d43979 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:41.865280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.866450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.866748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.867024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.876345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.878092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.888780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:41.889403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:41.889706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:41.889976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:41.890661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:41.890959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:41.892362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:41.899327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:41.900198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:41.901670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:41.903011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 305/603] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:41.903753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.907720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 299/604] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:41.908867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:41.956867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:41.999321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.027495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dd9d-3804-4c76-89f8-6c6b159c71db None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.044531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a338-4f7d-40b5-9039-8fcc3eadfda2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.077615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.078751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.079624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.080058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.081751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:42.082238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.083833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.085107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.085902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.086357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.086729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.098127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:42.100660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 300/605] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:42.101793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:42.108770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:42.109759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:42.110634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:42.117661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 306/606] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:42.118470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.233820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.238098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a272-613e-42d0-9968-1e2888a6c7ab None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.245792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3513-1185-425e-aee9-85d216634a79 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.273379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.274244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.274628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.275019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/939111fa56304aae981501d7a222b61f/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.286426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.287275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.287732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.288171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.291167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=939111fa56304aae981501d7a222b61f, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.292642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.296978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.300038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.302945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.313571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 307/607] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:42 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/939111fa56304aae981501d7a222b61f/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:42.314848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:42.315005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:42.316225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:42.317174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:42.321560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 301/608] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:42.322662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.439707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d158a90-603d-4ee1-97ba-f0ace6f8bdba None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.479493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.480322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.480616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.480896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.481709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:42.482023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.483604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.497606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 302/609] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:42.504006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.506890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771782-4aba-4b5f-ae85-030a29c781c9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.546505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.547145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.547426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.547698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.548426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:42.548731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.550168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.560052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 308/610] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:42.565262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.569781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.642461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.692840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042c9d-b04a-43c3-8366-92aed8f74884 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.693043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dad16-783b-496b-b14e-2e654c808372 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:42.732672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.733347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.733668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.733949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/3fa4877f580c4c708e7a6946b5f0d0a5/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.735185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:42.735912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.736199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.736634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.749589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=3fa4877f580c4c708e7a6946b5f0d0a5, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.751554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec705c-e798-4b9a-823b-f9ef21473e62 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.754482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:42.756570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:42.768244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 303/611] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:42 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/3fa4877f580c4c708e7a6946b5f0d0a5/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:33:42.769886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc274ab-694c-436c-8a7b-5fc461862209 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.770379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc274ab-694c-436c-8a7b-5fc461862209 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.770876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc274ab-694c-436c-8a7b-5fc461862209 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.772712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 304/612] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:42.778607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:42.779224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:42.779773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:42.781204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:42.782079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:42.782937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:42.782937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:42.782937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:42.782937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:42.789507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 309/613] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:42.791948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:42.826470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:42.829857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:42.929787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:42.975079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 305/614] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:42.992553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb92de-ff34-4a0f-bb47-400b63bd3919 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.001531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.043174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.044052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.044514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.044940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.045820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:43.046289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.048187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.052496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.065745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 310/615] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:43.071311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.121217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5ba6-9820-455d-a155-262c0d2cb828 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.157700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.158561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.158959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.159341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.170999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:43.176155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:43.177270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:43.178137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:43.178769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 306/616] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:43.187083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d88d9-d232-4bad-a35f-b405b4ebe6af None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.190840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.229940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.260159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.260870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.261149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.261440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.277880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.279348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:43.296659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:43.297678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:43.298620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:43.299169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 311/617] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:43.308160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.386337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.389525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08d33-52cb-4e4b-99e3-46b3921808b0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.429180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.430576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.430865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.431142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.431856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:43.432219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.433701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.457720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 307/618] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:43.466750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.514181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237a19-9608-4570-9488-f4b6adbc4057 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.565150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.565858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.566389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.566464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.567220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:43.567526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.568955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326421c6-62f5-4296-b671-d93499bab1d0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.589867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 312/619] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:43.591201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5800e8-6118-4795-96c0-64866ca1bfdf None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.591426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5800e8-6118-4795-96c0-64866ca1bfdf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.591655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5800e8-6118-4795-96c0-64866ca1bfdf None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.597478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 313/620] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:43.598296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5800e8-6118-4795-96c0-64866ca1bfdf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.619411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1428c7-6513-4f46-a3a3-c8c65933c6bf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.634316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.660523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.661760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.662296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.662790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.676166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.678011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-74c22e9a-f403-4f6e-b028-43f8060428f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:43.694091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:43.695037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:43.695923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:43.695923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:43.695923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:43.695923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:43.698978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 308/621] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:43.700533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.701047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.701655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.706440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5800e8-6118-4795-96c0-64866ca1bfdf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.723512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:43.725070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:43.737800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.744336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.745170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.745518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.745963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.756651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.758161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:43.774529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:43.775484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:43.777095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:43.777095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:43.777095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:43.777095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:43.781115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 314/622] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:43.781977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.805691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 309/623] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:43.807780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.876687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:43.893849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0345-a1dd-4095-b18e-8e8ffe8cc774 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.919999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c380-5e55-4110-b3d8-f77d09f4ab20 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:43.930235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.930855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.931133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.931405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.932089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:43.932457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.934025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.951752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 315/624] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:43.952727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.958239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:43.959125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:43.959606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:43.960099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:43.960985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:43.961610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:43.963173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:43.977579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 310/625] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:43.978653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:43.983065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.064614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e655e4-7ea6-47d8-8776-f73da713919c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.087618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d1239-2531-4c41-b1bf-e5d1dab1263c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.104909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.106033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.106463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.106981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.118356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:44.125330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:44.125705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:44.126601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:44.127458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:44.128108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.128108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.128108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.134914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 316/626] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:44.136438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.136756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.138622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.146953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:44.154542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:44.155507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:44.156464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:44.159243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 311/627] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:33:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:44.160228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.235205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.258985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e964f4-5798-400e-bdb5-485cbadde873 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.279931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305517f-05a3-48fd-9117-dcbd460dcf1c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.294222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.294873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.295152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.295425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.302471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.303937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:44.317161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:44.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:44.318986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 317/628] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:44.319933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.321824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.322873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.323409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.323883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.324940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:44.325471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.327069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.336736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 312/629] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:44.337933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.392673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.429192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028aff2-ce96-4c00-8c38-1b48196e65a8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.450602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf3d1-bb68-465c-ad32-a5033469ee41 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.463741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.464608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.464890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.465164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.466028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:44.466288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.467723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.480667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.492679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 318/630] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:44.493607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.499321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.500198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.500674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.501164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.502152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:44.502676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.504448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.518910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 313/631] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:44.520024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.605967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc2c0-a844-48eb-a449-d9d1afe5d120 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.636916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.637109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8181d3-e84a-4cf2-8dc0-0e663c4e9aa4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.651708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.652725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.653268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.653592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.667052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.668833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.671503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.672120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.672398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.672670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:44.687564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:44.688636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:44.689728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:44.689728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:44.689728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:44.689728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:44.690836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 319/632] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:44.691435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.736135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:44.751430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.752897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282c055-22a7-43c4-be8d-a27ec36923de None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.800819 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3db5-a2d3-4a9e-aa24-00bf942a9151 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:44.843203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:44.844008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.844288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.844567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/050cd624409b4c269af8805835ec5f53/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.860836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=050cd624409b4c269af8805835ec5f53, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:44.861660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 314/633] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:44.862777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486291de-d7f6-40ee-abfb-8744ce3b5d19 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:44.863064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486291de-d7f6-40ee-abfb-8744ce3b5d19 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:44.863337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486291de-d7f6-40ee-abfb-8744ce3b5d19 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:44.864674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 315/634] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:44.865237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486291de-d7f6-40ee-abfb-8744ce3b5d19 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.866920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:44.889446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 320/635] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:44 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/050cd624409b4c269af8805835ec5f53/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:33:44.889446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:44.917248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.006189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e79bb-cb90-4877-8aab-7f98b12129ef None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.012328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.037147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486291de-d7f6-40ee-abfb-8744ce3b5d19 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.050697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.051347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.051689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.051967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.067187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.069152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-32b97e42-48aa-4970-8650-5d13831ef8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:45.087395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:45.088504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:45.089383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:45.089383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:45.089383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:45.089383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:45.090259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.090971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.091339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.091689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.092256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 321/636] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:45.093713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.094186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.094624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.095587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:45.095977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.097535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.116717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:45.117528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 316/637] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:45.118538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.118810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:45.209454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 322/638] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:45.209454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.213528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.244509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab359181-842f-40b5-b583-3a7f8515a956 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.281345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.282038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.282277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.282553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.283237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:45.283543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.284917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb20d-5453-40ea-ad45-f30cb55f11a6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.302070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 317/639] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:45.302070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b868-8d2b-4a8c-a398-e43c2585bfcd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.302070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b868-8d2b-4a8c-a398-e43c2585bfcd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.302070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b868-8d2b-4a8c-a398-e43c2585bfcd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.305466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 318/640] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:45.306143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222b868-8d2b-4a8c-a398-e43c2585bfcd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.315623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2933a-b0ce-4324-a973-f6f55ef38de7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.316568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.352309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.352989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.353270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.353571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] PATH_INFO: `/v3/users/glance` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.361525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.362971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:45.374763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:45.375722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 323/641] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:45.376651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.428255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222b868-8d2b-4a8c-a398-e43c2585bfcd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.452686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.463714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.464359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.464639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.464910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.476003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b7675a93-d860-4b4d-bcbe-5f1f2c089ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:45.486730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:45.488463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:45.489879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 319/642] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:45.490786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.490877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.491153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.503584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8e2-f824-40ff-949e-5f9c7e404ddb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.509699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:45.511110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:45.543688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.544368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.544649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.544919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.551798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.553247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:45.564980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:45.565906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 324/643] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:45.571625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.579955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.601683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 320/644] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:45.602418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.678581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40707-dec0-4ca3-8968-a0762c52bb53 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.708108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.711506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db812-489f-43a5-99fa-b5f6de1cfbfd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.717237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.717877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.718159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.718429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.719313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:45.719664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.721141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.739969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 325/645] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:45.742264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.748988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.749640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.749926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.750195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.750908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:45.751216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.752562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.761930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 321/646] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:45.762580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.826567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:45.854905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbf17-0897-42e1-961d-4a711ff3dd0b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.870928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ecb47-c223-4b60-8d54-c1891740882b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:45.893430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.894066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.894359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.894632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.895377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:45.895683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:45.897115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:45.909018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 326/647] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:45.909652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:45.910131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.910700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:45.910981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:45.911252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:45.926838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:45.934522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:45.935417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:45.936252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 322/648] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:45.936939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:45.965465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.022162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c232a-0de2-4ee0-aa6a-1c741423a451 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.053827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e373-7bdb-4881-b78f-d1c884556fc1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.059033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.059660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.059943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.060219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.073445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.093701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.094372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.094665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.094941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.106874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.108414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:46.124008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:46.124916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:46.125864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:46.125864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:46.125864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.125864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:46.125864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 323/649] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:46.126150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.139330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.140807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.191765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.240791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22716240-c371-48dd-a7c5-4456d90cc607 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.251603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 327/650] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:46.252266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.281028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.281673 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.281956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.282227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.282999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:46.283304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.284710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.290694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 324/651] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:46.291489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.336607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.401593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c20617-8837-4725-87c7-6b3de6ee1fa2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.417809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a422c2-7986-4a7b-b712-ae6b5e85e635 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.449200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.449731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.450009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.450281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.450997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:46.451300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.453049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.462013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 328/652] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:46.462495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.470093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.470725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.471007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.471280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.471980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:46.472284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.473681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.482374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.488453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 325/653] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:46.489291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.587453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b648-7d80-4675-8f61-2bd6cafb343c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.604644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.613136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b955a-970e-4bd1-95d2-cd71d1969936 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.630318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.631383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.631956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.632419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.645626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.647584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.656415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.657067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.657349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.657651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:46.665443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:46.666401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:46.667910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:46.667910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:46.667910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.667910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:46.669533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.670152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 329/654] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:46.671111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.676478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:46.695774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:46.696756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:46.697706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:46.697706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:46.697706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:46.697706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:46.700132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 326/655] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:46.705357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.752355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.807799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fc9f-993c-43fd-8a4e-ae659dd6c7a9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.817727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de611e1d-587e-496c-b22f-eefd319a5d43 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:46.847884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.848960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.849469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.849942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.859478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.861661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.861871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:46.862502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:46.862787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:46.863053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:46.863925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:46.864379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:46.866810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:46.876081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:46.877058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:33:46.878030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:46.880789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 330/656] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:46.881801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.886382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 327/657] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:46.889147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:46.899729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:46.999232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2d94-cf54-40c4-8d8f-050a7aa524c6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.013878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c47c-5e45-4568-b99d-fc7f4e6f5f44 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.022530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.038695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.039315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.039592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.039859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.040542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:47.040840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.042378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.050480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.051107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.051384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.051656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.052436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:47.052742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.054183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ad46-2b55-4c0e-bc8b-da89cccec760 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.061105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 331/658] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:47.062216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.078120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 328/659] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Jul 29 11:33:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:47.078120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791b8c-2c4a-440e-83c7-b71f5efbc328 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.078120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791b8c-2c4a-440e-83c7-b71f5efbc328 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.078120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791b8c-2c4a-440e-83c7-b71f5efbc328 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.081061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 329/660] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:47.081773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff791b8c-2c4a-440e-83c7-b71f5efbc328 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.149018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.182752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b5290-0a03-41d1-8b33-82a0fc20f927 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.196796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff791b8c-2c4a-440e-83c7-b71f5efbc328 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.223317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.223964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.224246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.224560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.231489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.232931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.233782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.234422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.234713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.234985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.242186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.243610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:47.245455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:47.246472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:47.247410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 332/661] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:47.247882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-91f1d0d3-2f2b-4355-b008-7fc4ef12d479 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:47.263105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:47.264063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:47.265078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 330/662] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:47.266536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.266536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.266536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.283284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:47.284494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:47.297178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.354556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 331/663] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:47.355401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.375174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30257be7-f9a4-4399-a31d-6040921ddd80 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.410910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.411572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.411865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.412146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.417984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.467345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e46fc3-14d2-421e-98a2-c9dd5aeee0dc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.483627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.485343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.508704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.509367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.509640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.509918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.510668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:47.511007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.512514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.529665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 332/664] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:47.529665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.533403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.608089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 333/665] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:47.608089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.634427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafd380-f07d-4397-ab08-6e2d4b0a395f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.649541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.672147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.672764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.673039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.673315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.674127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:47.674432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.675870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.693665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 333/666] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:47.698723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.717195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3dafe-a53a-4fb3-abf1-5bd24b16160b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.754219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.754910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.755196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.755473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.764396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.767410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:47.772814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:47.773790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:47.774613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:47.779129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 334/667] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:47.780047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.804814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911a6bc-8449-43a6-ad97-9e62f72c3374 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.843416 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.844054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.844307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.844576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.845349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=6bfc7686898b406bb89f9f0280308004) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:47.845693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.847108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.853045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 334/668] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/role_assignments?user.id=6bfc7686898b406bb89f9f0280308004&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:47.853845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:47.903155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:47.919208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db632-51e6-4363-887e-b467ba4b6aeb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:47.964568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:47.965279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:47.965594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:47.965867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:47.977643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:47.979876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:47.997158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:47.998193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:47.999078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:47.999078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:47.999078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:47.999078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:47.999078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 335/669] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:47.999359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.001072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304545c2-d2e3-410f-a9da-8aa77cc0ec12 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.049012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.049604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.049884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.050155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.074375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.136504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.138290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.149828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9d18-9d0d-434d-a7c9-7d02e27a05e2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.193647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.194365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.194718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.195070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.195849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:48.196218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.197702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.198470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.211081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 336/670] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:48.212089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.292047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 335/671] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:48.292047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.329294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c780eb-e6fb-49aa-b8ff-8515153cda3c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.348214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.375450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.377452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.377927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.378372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.379238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:48.379681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.381238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.400372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 337/672] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:48.401823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.424234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25926f7-6fee-46e2-b1c6-f97327ad4448 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.472871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.474303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.474692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.474976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.479505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.488907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.490425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:48.506675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:48.507844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 336/673] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:48.509293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.516987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564cd2-7eaf-4874-988f-0476f3c29f94 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.555569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.556600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.556879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.557452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.567503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.568924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f955918d-7de0-41d8-b5b1-034fe86cd45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:48.585073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:48.586008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:48.586905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:48.586905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:48.586905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:48.586905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:48.591636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 338/674] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:48.592980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ed52-10ba-4d92-8bad-19870536c872 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.593268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ed52-10ba-4d92-8bad-19870536c872 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.593582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ed52-10ba-4d92-8bad-19870536c872 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.594836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 339/675] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:48.595515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4ed52-10ba-4d92-8bad-19870536c872 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.621649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef023d58-3823-4c7e-b7be-f6e140e7e95f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.626939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.660322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.660960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.661242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.661547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.669295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.670765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:48.682029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:48.683073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:48.683946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:48.685715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 337/676] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:48.687422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.711225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4ed52-10ba-4d92-8bad-19870536c872 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.748132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.748527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.749121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.749399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.749701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.750463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:48.750799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.752241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6300ca-7197-4b5e-98df-e1f30d7e08a4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.769897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 340/677] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:48.769897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.769897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.769897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.785195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:48.786492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:48.809113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f181-b56c-4255-a7ac-7a91618d8fa7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.844549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:48.845177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:48.845555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:48.845928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:48.846716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:48.847115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:48.848563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:48.861887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 341/678] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:48.861887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.869143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 338/679] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:48.869143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:48.888716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:48.973787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c39b7-4d4e-4d86-afaf-54a236e85c59 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.982616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195b55-9f83-4501-a12e-11ce2c25c367 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:48.983804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.012366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.013274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.013586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.013866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.019039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.019771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.020232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.020515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.021312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.021459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.021848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.022784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.023630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.035912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 342/680] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:49.036190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:49.037080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:49.038060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:49.038608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.042164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 339/681] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:49.043086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.123649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.152293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119595c-140a-490d-961a-9a6f1cf0ca5a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.154282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608baf5-c15a-4fe8-8834-321ebcd5b7d4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.190881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.191532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.192165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.192165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.194574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.195672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.196103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.196523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.199793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.201246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.207972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:49.212684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:49.213914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:49.214813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 343/682] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:49.215305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:49.217195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:49.218183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 340/683] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:49.222155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.251865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.329360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f7ad-7f71-4d7b-81ac-a12081d1e738 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.336406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6c279-dde6-45f5-b94d-22d7d3ab9199 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.365276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.365916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.366196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.366463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.367237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=939111fa56304aae981501d7a222b61f) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.367544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.368959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.372082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.372444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.372698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.372982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.373258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.374128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.374381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.375808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.381452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 344/684] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/role_assignments?user.id=939111fa56304aae981501d7a222b61f&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.381452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.406529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 341/685] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.407545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.500657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e829f-889a-4353-abf9-5eba2c08f0a0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.523546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.540920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.541709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.542213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.542569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.543351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.543661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.545131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.545802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0c81-f763-4ad1-a4e5-d6b494810f2a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.559686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 345/686] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.560639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.596829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.598465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.598465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.598465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.598925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.599115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.600708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.613381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 342/687] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.614467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.638846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.697657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3f45-be91-441a-8d13-fa211a3cf341 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.733129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c5aa-6e6d-48c0-b336-de8da784adea None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.744260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.745218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.745535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.745814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.770779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.771564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.771943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.772308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.773182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=3fa4877f580c4c708e7a6946b5f0d0a5) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:49.773620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.775137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.781966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 343/688] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/role_assignments?user.id=3fa4877f580c4c708e7a6946b5f0d0a5&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:49.782977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:49.799590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.846917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.848384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:49.903095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea527-bb2e-4dff-8643-87cf58b69787 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:49.931394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:49.956873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:49.957955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:49.960078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:49.961323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:49.986122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:49.989245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.003782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 346/689] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:50.011626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:50.017766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:50.018649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:50.019533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:50.019533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:50.019533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.019533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:50.028743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 344/690] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:50.033283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.117785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.142859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c913a-a9f0-45f5-8cbe-e78fddccfa35 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.169681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55909-46f9-4782-b3c8-dade119ae156 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.193947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.194832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.195463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.195856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.209490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.211060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.212749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.214124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.214379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.214549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.215328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:50.215637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.217074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa940b9-d8b2-423e-bed4-c3087dd9cd60 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:50.228789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:50.230015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:50.230930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:50.230930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:50.230930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.230930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:50.231158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 345/691] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:50.231230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 347/692] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:50.231305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4c95-248c-41d6-86a8-4a35e7717a0f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.235511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4c95-248c-41d6-86a8-4a35e7717a0f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.235814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4c95-248c-41d6-86a8-4a35e7717a0f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.236040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.237391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 346/693] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:50.238158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4c95-248c-41d6-86a8-4a35e7717a0f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.255226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.353527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12efa-553b-46e9-b12b-6bea37e35bae None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.376816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4c95-248c-41d6-86a8-4a35e7717a0f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.389964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.390563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.390840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.391166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.391866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:50.392157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.393640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df768c-1201-4fdf-a5b6-5f0f22595df9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.405984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.407056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 348/694] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:50.408556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.408880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.409187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.420020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.420964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.421490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.422001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.428789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:50.430094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:50.430521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.432311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:50.445491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:50.446494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:50.447433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 347/695] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:50.448554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.505031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 349/696] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:50.505908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.518348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.577750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a11c2-f54d-4ada-9e0d-860b1dcc0b91 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.614063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.614772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.615059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.615337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.622547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.624098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.630676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ebd18-a213-40f2-95fc-19b0cb87582c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:50.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:50.639410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:50.640286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 348/697] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:50.641243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.669730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.670505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.670730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.671001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.671792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:50.672094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.673756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.691590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.694451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 350/698] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:50.695750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.756683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643fc6-a74e-47be-a33b-84d14eaac726 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.764243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.793555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.794204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.794486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.794900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.805965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.807977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.811966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c33b2-d659-4f23-be2f-8520d8c1b955 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:50.822868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:50.823914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 349/699] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:50.829686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.861634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.862955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.863527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.863999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.865010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:50.865597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:50.867355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:50.881175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 351/700] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:50.882379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:50.931669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:50.937731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2380-ce2c-470b-9c9c-5a2b80511a3b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:50.972983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:50.973681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:50.973959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:50.974238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:50.998539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912bbe1-7b0c-41a6-8c88-9466a56e5efb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.021144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.037903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.038882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.039406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.039909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.040827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:51.041325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.043064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.046100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.047701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.061668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 352/701] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:51.062971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.147525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.157778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 350/702] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:51.158675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.182152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b38f-8088-4408-bde4-1ea609371fce None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.224473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.225483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.226047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.226632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.227620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=050cd624409b4c269af8805835ec5f53) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:51.228127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.230563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.237277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 353/703] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/role_assignments?user.id=050cd624409b4c269af8805835ec5f53&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:51.238590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.272204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb4b0d-de3e-4e75-800a-eee5474540a9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.292331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.310236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.310886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.311469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.311469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.312115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.313725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.355013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 351/704] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:33:51 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:51.367141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e048f-e59e-4ff2-8510-475739560669 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.425535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.426634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.427114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.427584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.444532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.446435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:51.469687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:51.470632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:51.471940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:51.471940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:51.471940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:51.471940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:51.471940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 354/705] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:51.476885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.542626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.607774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561e076-81f1-4eff-9feb-914b5bd40ce1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.643863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.644871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.645297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.645740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.646466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:51.646825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.648256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f544-0f50-4488-a692-5fb021636d93 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.661667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 352/706] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:51.667302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.752113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d101be-9659-444d-93e5-e8ce356ac1bf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.752747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d101be-9659-444d-93e5-e8ce356ac1bf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.753232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d101be-9659-444d-93e5-e8ce356ac1bf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.754878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 353/707] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:51.763408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.763983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.764466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.777821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.784254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4990f-22f8-46eb-98bc-9c52313e48d6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:51.787602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:51.789070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:51.820735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:51.821544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:51.821838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:51.822288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:51.830228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:51.831965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:51.844643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:51.845647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:51.846537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 355/708] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:51.851635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.874668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 354/709] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:51.898488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:51.947749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:51.980701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de945f6-c05c-445f-b030-d6578c7bd223 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.021192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.021798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.022136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.022796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.023546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:52.023852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.025562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.040508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98915d49-62a5-44f8-b0e1-dd4cf38020c7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.040950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 356/710] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:52.047988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:52.067653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:52.112284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.113468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.114067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.114550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.115410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.117233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:52.139841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:52.140851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:52.141713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:52.153618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 355/711] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Jul 29 11:33:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:52.154970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:52.160127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b61f6-e498-4ab9-b26f-7f68def04e08 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.214539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.215444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.215730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.215998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.216790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:52.217096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.218724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f0683-2d2f-47ec-85fa-be615b516887 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.226264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 357/712] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:52.227818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14359-1c3c-4c8a-9cce-5e6a172238f6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.228097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14359-1c3c-4c8a-9cce-5e6a172238f6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.228371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14359-1c3c-4c8a-9cce-5e6a172238f6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.234904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 358/713] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:52.238300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.238564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.239297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.282927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:52.285520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:52.324372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a499d-0b67-46bc-942a-89b504272a87 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.341808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:52.389793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.390434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.390762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.391038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.391830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:52.392142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.393726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.402952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 356/714] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:52.406617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:52.411208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 359/715] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:52.458849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:52.485835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:52.532727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196236-c67c-429b-84f4-78399778b882 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.569988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04739b0f-0207-4096-be6d-73a2ba69c6f2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.577381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.578041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.578319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.578593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.579573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:52.579573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.580914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.592734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 357/716] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:52.628314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.629352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.629925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.630424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.631265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.632841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:52.649159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:52.650294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:52.651786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:52.659137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 360/717] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:52.670651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:52.753923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:52.829024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76402f-0ad9-4792-98b7-735481a15cb8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:52.866815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:52.867458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:52.867736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:52.868005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:52.868691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] RBAC: Adding query filter params (name=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:52.868991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:52.870565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1253289-ec17-4651-ae5a-f20e43221171 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:52.876275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 358/718] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:52.881817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:53.101060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:53.128402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af038a-23f8-4bbb-92f5-b63cb0afbba5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:53.163417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:53.164040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:53.164322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:53.164597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:53.165273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:53.165605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:53.167160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34f48-872b-4fb7-b405-bfb5d358a7d1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:53.173206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 361/719] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:33:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:53.999492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192177-c536-48c6-8a32-894f94d9172f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.000476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192177-c536-48c6-8a32-894f94d9172f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.000952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192177-c536-48c6-8a32-894f94d9172f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.002805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 359/720] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:54.007625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.008154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.008629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.031193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:54.032738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:54.057351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023b5a-af85-4bb0-ac69-67667055c3e5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.057707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023b5a-af85-4bb0-ac69-67667055c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.057985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023b5a-af85-4bb0-ac69-67667055c3e5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.059896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 360/721] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:54.065847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.066138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.066421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.089985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:54.091477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:54.151633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 362/722] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:54.183675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.214492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 361/723] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 11:33:54.248350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.288112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:54.289784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:54.347867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d51de-f601-428d-88fa-381fbe77cf05 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.407526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.408224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.408509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.408779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.427187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302dfab-9098-45b7-9d74-e9a6a9770311 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.431251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:54.443538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:54.444525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:54.445366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 363/724] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:54.452131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.495308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.495966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.496246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.496518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.507622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:54.513481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:54.515323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:54.516426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 362/725] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:54.526034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.584903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f1bf-5e65-4683-a2cc-9aa7c5a56e3e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.621650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:54.632250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.632878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.633156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.633439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.639988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:54.642341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:54.642689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:54.644161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:54.653547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0314-1ac3-47cb-becb-be2d0b578055 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.659766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 364/726] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:54.673906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.817774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.818414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.818694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.818971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.819686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:54.819990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:54.821953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:54.832305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 363/727] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:54.838254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.860261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135deb-cf1c-4e41-8260-f957df776309 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.907408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.908343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.908622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.908892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.923764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:54.925653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-59e85c25-d5a2-4fc1-95d7-9f274e0dbe48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:54.945388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:54.947181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 365/728] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:54.948777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430769-ac19-4aee-894f-68419f8c560b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.949354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430769-ac19-4aee-894f-68419f8c560b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.949354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c430769-ac19-4aee-894f-68419f8c560b None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:54.954179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 366/729] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:54.954179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c430769-ac19-4aee-894f-68419f8c560b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:54.955724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cee7b-bce9-4fa4-af27-c84313954628 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:54.991258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d492691-648e-40df-a1de-50337980023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:54.992003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492691-648e-40df-a1de-50337980023b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:54.992284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492691-648e-40df-a1de-50337980023b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:54.992559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492691-648e-40df-a1de-50337980023b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.002811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.005290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d492691-648e-40df-a1de-50337980023b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.006851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d492691-648e-40df-a1de-50337980023b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9d492691-648e-40df-a1de-50337980023b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:55.022583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:55.023494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:55.024350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:55.024350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:55.024350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:55.024350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:55.024350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 364/730] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:55.025408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ce12-1139-447e-adba-3ed76fd47c6f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.025542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ce12-1139-447e-adba-3ed76fd47c6f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.025779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ce12-1139-447e-adba-3ed76fd47c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.032640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.044183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6ba8ce12-1139-447e-adba-3ed76fd47c6f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:55.045370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6ba8ce12-1139-447e-adba-3ed76fd47c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:55.073023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c430769-ac19-4aee-894f-68419f8c560b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.109152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.110008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.110441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.110714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.111393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:55.111695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.113078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95737591-cce0-4947-a0a2-12022604c47b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.114796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 365/731] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:55.116062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810b63-87d4-4aab-a158-71e741a5c096 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.116351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810b63-87d4-4aab-a158-71e741a5c096 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.116622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810b63-87d4-4aab-a158-71e741a5c096 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.125236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 366/732] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:55.125236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36810b63-87d4-4aab-a158-71e741a5c096 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.132562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 367/733] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:55.134243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.134728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.135260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.154638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:55.155889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:55.233786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 368/734] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:55.234788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.251531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36810b63-87d4-4aab-a158-71e741a5c096 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.273584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.284707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.292289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.293200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.293200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.293487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.294161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:55.294519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.295975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.312850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 367/735] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:55.313750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.349266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d7f5-84d9-4f9a-9de8-d00911e622f2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.384406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.384903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.385219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.385518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.396641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:33:55.402394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:55.403382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:55.404236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 369/736] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:55.405003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.425753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f80244-e676-4495-8194-f8761f3a785e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.461290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.462129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.462407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.462678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.470550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.471977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:55.485370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:55.486586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:55.487570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 368/737] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:55.488147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.508068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.520121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3ac2-5346-4c63-be37-86bf4ea518b3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.544156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.563989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.564605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.564882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.565149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.565870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.567228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.586139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 370/738] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:33:55 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:55.586980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.609992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc52d-5221-4de2-80b4-6861ccb127c5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.663945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.664970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.665522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.666175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.677069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.679175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:55.695663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:55.696674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:33:55.698201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:55.701754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 369/739] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:55.702963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.721780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e60b3-d35a-4640-bcc5-3456f44aa055 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.762226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.763529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.764021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.764533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.765502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:55.766016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.767696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.785508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 371/740] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:55.786794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.803613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.838008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693bbce-93a1-43a2-828f-82f1ac16fb1c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.849437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:55.875575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.876195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.876472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.876742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.877554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:55.877857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.879293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.904080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 370/741] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:55.904080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:55.908157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dcf6-b12b-4828-ad2a-cc063cd8a40c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:55.943622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:55.944239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.944520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.944790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.945611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:55.945915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:55.947345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ce5e1-e9d8-4709-9663-6ad0d43b6054 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:55.966089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 372/742] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:55.967226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5597c7-70dd-4a34-957c-4dce62c5d133 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:55.967523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5597c7-70dd-4a34-957c-4dce62c5d133 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:55.967780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5597c7-70dd-4a34-957c-4dce62c5d133 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:55.969116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 373/743] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:55.973623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5597c7-70dd-4a34-957c-4dce62c5d133 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.015195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03e5af-f3b3-4145-a372-a3a3d66247c9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.049613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.054000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.055066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.055352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.055630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.067200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.068636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.084136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5597c7-70dd-4a34-957c-4dce62c5d133 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:56.085909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:56.086796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:56.087686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:56.087686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:56.087686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.087686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:56.087686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 371/744] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:56.087969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.110052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.132205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.133249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.133784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.134332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.205533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c04e-bf9e-495b-b0da-576070090648 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.216606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.218270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e240fd-4314-4ce4-8c9e-ddcdbf702db4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.241358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.241996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.242278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.242548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.293011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.314446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.315939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.332739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 374/745] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:56.334869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.335427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.335859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.339648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.359317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:56.360852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:56.422020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 372/746] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 11:33:56.422695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.453517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 375/747] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 11:33:56.453517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.524583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e2fb1-118c-409f-856a-0f2abd13a8d5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.543533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.562226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.562844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.563122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.563393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.563761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a3de-35a3-440d-b8a6-6243257c85c0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.564073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:56.564381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.565403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.565781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.582263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 373/748] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:56.582263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.606284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.606954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.607274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.607540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.618282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.620290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:56.636147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:56.637047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:56.638232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:56.638232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:56.638232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.638232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:56.638232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 376/749] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:56.638508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.689564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35274e-9670-4d6a-a726-379d8bbea8e7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.723893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.724471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.724756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.725025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.736971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.738444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.745141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a610b-49f2-4051-8d00-94c9a3fbd8b3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:56.753105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:56.754029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 374/750] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:56.755661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.788674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.789319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.789632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.789920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.790614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.791209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.792074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.813588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 377/751] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:33:56 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:33:56.814910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:56.836434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:56.891449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b871dd-c699-4d62-8b75-4f1ae6257ad3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.940486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:56.941749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:56.942194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:56.943105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:56.950523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497423f-7c59-419f-bd33-498875f4b8ed None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:56.958306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:56.960789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:33:56.979794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:56.980890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:33:56.982216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:56.984624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 375/752] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:56.986359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.000878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.001563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.001848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.002124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.002833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.003445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.005030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.021531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 378/753] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.022425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.089647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.099931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.106035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141458a-dd5d-4dc6-98c3-08d79b9ddda2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.127701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28023cfb-2284-4bcf-bd3f-303d114a54e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.145738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.146721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.147187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.147668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.148535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.149017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.150588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.163229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.163863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.164146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.164424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.165221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.165669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.165896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 376/754] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.167476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.167931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.187979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 379/755] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.188644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.285467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914b0-b15e-4d30-b4d3-9b87a59857f6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.294858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b0b5-7e0b-4cc6-876b-66aa4554b447 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.326370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.327726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.328924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.329466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.329994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.332212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.333075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.333667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.334161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.340121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.341834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.342183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.343738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:57.355872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:57.357015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:57.357924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:57.358371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:57.359136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 380/756] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:57.360017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.362949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 377/757] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:57.367868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.378076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.467936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d5db-656b-48a5-a225-4382819b3103 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.484773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677fba8-c6b4-488e-8236-3797bfa360a3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.503750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.504508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.505059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.505192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.517370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.519012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.524844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.525903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.526963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.527418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.528441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.528927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.530572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:33:57.535149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:57.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:57.536943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:33:57.536943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:33:57.536943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:33:57.536943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:57.536943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 381/758] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:57.538106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.547149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 378/759] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.548359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.588937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.625883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.649052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34880-8f16-4f99-9c18-d6c9922a6fd0 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.665892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076dd7-3e6f-4b49-97a7-d22d86a8b24c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.685867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.686537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.686922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.687257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.688083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.688462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.690009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.703052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 382/760] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.704067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.707172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.708351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.708841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.709327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.710252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.710774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.712451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.726429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 379/761] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.727523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.808226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f595-089f-4119-9332-9931186ecfff None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.811455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.836751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66847-842a-4a0a-bf8d-4b2c790b15b3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:57.848714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.849481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.849864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.850248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.851164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=eb10a008687543f496ff2a8ce3591bfd) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.851873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.853074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.865453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 383/762] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/role_assignments?user.id=eb10a008687543f496ff2a8ce3591bfd&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.865453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:57.880223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:57.892556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:57.893343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.893726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.894074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.895013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=050cd624409b4c269af8805835ec5f53) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:57.895465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:57.897154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6070-8798-4743-9142-8a11881654b0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:57.912631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 380/763] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/role_assignments?user.id=050cd624409b4c269af8805835ec5f53&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:57.914239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f519-339d-4f84-876e-a3583ce14472 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.914604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f519-339d-4f84-876e-a3583ce14472 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.914954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f519-339d-4f84-876e-a3583ce14472 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.917078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 381/764] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:33:57.923328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:57.923709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:57.924186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:57.961549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:57.962786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:58.047488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ab80b-586d-4eaa-9a2f-398b892a2730 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.088722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 382/765] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:33:58.109876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.110525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.110808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.111083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.118022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.119473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.126283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:33:58.142198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:58.143140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:33:58.144086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:33:58.146674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 384/766] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:58.152665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.200995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:58.244573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e232cda-666e-4a5b-b843-381c32eef854 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.281172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:58.289141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8244b-d6bc-4416-956b-bfebf4c99a2f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.299852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.300510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.300795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.301074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.301743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.303114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:58.313618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:58.314595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:58.315420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 383/767] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:33:58.322248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.359280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.361056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.361343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.361645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.362747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:58.363068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.364514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.379116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 385/768] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:58.386027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.467963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a8dd7-2633-4a1b-99c1-fe287f622923 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.505208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.506259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.506748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.507227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.508105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:58.508614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.510305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.516285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 384/769] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:58.522054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.572930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:58.575591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:58.588990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e7cd-785d-48f0-88f1-ad687849b177 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.631678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.632280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.632557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.632978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.637220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=a2502e6309ca4a688de48416b09d16c3, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.640063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.664835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 386/770] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:33:58 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:33:58.680216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf24ecb-6e45-401c-8218-e4993279b89d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.736372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.737067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.737358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.737657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.738360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:58.738666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.740154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.750501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 385/771] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:33:58.755931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:58.918779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea750d-0f50-406c-9e91-e05238e4ba92 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:58.971351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:58.971987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:58.972273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:58.972552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:58.973318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] RBAC: Adding query filter params (interface=public, service_id=def94916ed5a45bc8ddebaa4de588d65, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:58.973918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:58.975297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68552044-8077-4d8d-8cff-d4c481cc12ed None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:58.987534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 387/772] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/endpoints?service_id=def94916ed5a45bc8ddebaa4de588d65&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:58.993166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:59.069957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298872b4-bb2c-4ac6-8869-8c482e0cb741 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.070244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298872b4-bb2c-4ac6-8869-8c482e0cb741 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.070524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298872b4-bb2c-4ac6-8869-8c482e0cb741 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.072141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 388/773] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:33:59.078717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.079003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.079281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.114538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:33:59.115771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b084f-2b3f-4928-8916-8738af7ef48d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:59.116335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:33:59.128396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:59.135107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:59.160179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:59.160903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.161845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.162215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.162982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:59.164471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:59.171390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 386/774] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:33:58 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:59.228518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 389/775] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:33:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:33:59.251604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:59.370961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c390e-38f1-409a-ac7b-0babb828d325 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:59.409040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:59.409722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.410007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.410284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.410922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:59.412304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:33:59.422693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:33:59.423694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:33:59.424522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 387/776] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:33:59 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:33:59.430163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:59.538254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67da024-86d5-4f8a-9c50-66f5322335cf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:59.576040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:59.576665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.576997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.577275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.578039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] RBAC: Adding query filter params (name=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:59.578349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:59.579719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:59.584560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 390/777] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:33:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:59.590562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:59.637613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:59.717996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad133d-747e-4315-adc9-ff47f7c68f74 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:59.765632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:59.766253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.766534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.766808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.767486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:59.767787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:59.769150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:59.774483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 388/778] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:33:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:59.780832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:33:59.789916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:33:59.903766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae264d2-7aa6-4f67-8ee6-ee3b0d27d542 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:33:59.955519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:33:59.956157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:33:59.956437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:33:59.956700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:33:59.957498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] RBAC: Adding query filter params (interface=public, service_id=888c07c5ee4d417c809b43bb9598b8f7, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:33:59.957880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:33:59.959448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b4aa-8ea9-4b38-8446-1a3c0bfdbab5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:33:59.965824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 391/779] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:33:59 2022] GET /identity/v3/endpoints?service_id=888c07c5ee4d417c809b43bb9598b8f7&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:33:59.971420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:00.076969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bf95-4e6b-41a0-8bf0-d902de999969 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:00.080326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:00.113873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:00.114501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.114778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.115050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.115700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:00.117055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c81c82-880b-4cc7-9909-286c5b1a7922 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:00.123348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 389/780] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:33:59 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:00.281204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab04a2-34df-433b-a133-9fc1f0360b66 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.281538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab04a2-34df-433b-a133-9fc1f0360b66 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.281730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab04a2-34df-433b-a133-9fc1f0360b66 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.283350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 392/781] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:00.288938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d25d8-c596-40f2-afe4-bcc19fddf21d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.289431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d25d8-c596-40f2-afe4-bcc19fddf21d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.289512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d25d8-c596-40f2-afe4-bcc19fddf21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.314473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-683d25d8-c596-40f2-afe4-bcc19fddf21d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:00.316003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-683d25d8-c596-40f2-afe4-bcc19fddf21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:00.389819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 390/782] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:00.412766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab04a2-34df-433b-a133-9fc1f0360b66 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:00.442692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14a3-4a13-45bc-854c-6006581610c2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.443322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14a3-4a13-45bc-854c-6006581610c2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.443806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14a3-4a13-45bc-854c-6006581610c2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.445661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 391/783] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:00.451203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.451746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.452265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.471474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:00.473054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:00.546366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 392/784] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:00.547131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:00.587612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:00.614319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab04a2-34df-433b-a133-9fc1f0360b66 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:00.650599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:00.651955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.652289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.652568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.654775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:00.678472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:00.684086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:00.685011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:00.685904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:00.697951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 393/785] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:00.704115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:00.757318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447ac99-4e5f-49cd-afb5-17414b3032d7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:00.825181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:00.826325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.826611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.826892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.863972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:00.869464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:00.870939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:00.871769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 393/786] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:00.876932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:00.892748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe082a7-07ce-4b6b-914c-529736ba00e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:00.948466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:00.956258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:00.956885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:00.957169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:00.957466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:00.958191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:00.958497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:00.961458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:00.985089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 394/787] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:00.986093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.047439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:01.069505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444af6-567c-4d2f-95bf-6e3017af1bbe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.132890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.133891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.134072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8008-6621-4c09-98e7-163b0e82d6e1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.134563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.135051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.136895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:01.137208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.144652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.154036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 394/788] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:01.162352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.191877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.197531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.197531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.197531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.215648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.217118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:01.248009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:01.248970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:01.249868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:01.249868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:01.249868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:01.249868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:01.251336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 395/789] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:01.255996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.309667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:01.368039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d537-f7b5-4507-a9f3-05286fd1d122 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.403417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.403957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.404314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6fa58-d7fd-4198-b053-48ea3fcdf808 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.405006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.405006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.405964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:01.406272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.413446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.422704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 396/790] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:01.428958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.483074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.484257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.485452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.486482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.508704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.512665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:01.539528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:01.540654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:01.541801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:01.541801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:01.541801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:01.541801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:01.544799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 395/791] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:01.554325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.558207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:01.601439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6e25-8956-4f80-ab77-2d784eb7008c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.602353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:01.664255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.666295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.667346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.668761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.684851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.686364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:01.706537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:01.707565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:01.708515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 397/792] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:01.725830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.734848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0dfd6-2f94-44f9-a0fa-bea11f3ea1cc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.786341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.787523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.789862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.790377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.791280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:01.792510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.794943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.816419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 396/793] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:01.822371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.874711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3977-6f38-4826-b782-8d26e49b9ced None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:01.910294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:01.910914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.911188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.911457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.912242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:01.912543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:01.914121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d445-487d-4d52-98d1-028e337811f0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:01.933451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 398/794] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:01.934781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2097e-4545-4cf0-a470-a6ec949a8a9e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:01.935064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2097e-4545-4cf0-a470-a6ec949a8a9e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:01.935338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2097e-4545-4cf0-a470-a6ec949a8a9e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:01.936761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 399/795] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:01.939743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2097e-4545-4cf0-a470-a6ec949a8a9e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:01.942946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:01.967519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.019885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14729952-40ed-43bc-b2d5-ae7b70d5c852 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.052145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2097e-4545-4cf0-a470-a6ec949a8a9e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.077997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.079081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.079597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.080076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.090267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.091170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.091675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.092128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.093314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.096060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.103151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.104805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-18db16d8-ac0c-47fe-8a43-614ea810962a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:02.119219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.120707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:02.121667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5c667185-9a31-4ac7-af72-422457ebb3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:02.127395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.128417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 400/796] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.129282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.130453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 397/797] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:34:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.131645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860465f-e18c-4d1b-aa31-d1ddb7f67eaf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.132113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860465f-e18c-4d1b-aa31-d1ddb7f67eaf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.132567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860465f-e18c-4d1b-aa31-d1ddb7f67eaf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.139866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 398/798] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:02.139866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860465f-e18c-4d1b-aa31-d1ddb7f67eaf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.142151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:02.144133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:02.218652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 401/799] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:02.219576 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.245347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.272037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860465f-e18c-4d1b-aa31-d1ddb7f67eaf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.296495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.309568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.310193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.310477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.310749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.311452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:02.311761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.313125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456492-b256-42ec-8fd7-be6a4b976812 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.326017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 399/800] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:02.327211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.327503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.327777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.347454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:02.347745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5d588-207b-4ae2-8859-e4c762939195 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.348645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:02.384055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.386025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.386493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.386772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.387577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:02.387885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.389615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.410142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 402/801] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:02.411156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.422920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 400/802] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:02.424403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.491680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.533214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421454a-c39a-4814-89f4-8c870039b48b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.535406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796371-c9a7-4d13-ae56-8817c8846f95 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.548411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.571736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.572382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.572696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.572857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.572994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.573580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.573952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.574228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.579774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.581209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.585495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:02.590470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.591392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:02.592212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:02.593347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.594303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:02.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:02.597014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 403/803] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.597434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.598937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 401/804] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.599767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.703245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5724-d99d-4b2c-9f5c-ef819316646b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.703650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f42c7c-73cf-4276-8e18-0f07e6681070 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.726711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.739442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.739892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.740257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.740542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.740638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.740828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.740970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.741101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.741821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.743148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.752169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.752967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.753887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 11:34:02.754720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:02.756158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.756238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 402/805] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.756238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:02.776700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:02.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:02.778789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:02.778789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:02.778789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:02.778789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:02.779749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 404/806] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:02.779749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.795136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:02.863754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a244-b43f-4867-b2f0-e426ca6a2aad None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.888040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5757623-1703-47fa-8ab1-4df81e35b5ad None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:02.897946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.898565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.898845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.899132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.899832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:02.900134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.901547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.909697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 403/807] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:02.910479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.925720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:02.926337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:02.926618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:02.926892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:02.927643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:02.927947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:02.929378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:02.941787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 405/808] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:02.942570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:02.977828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.009163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.014185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704246c-6027-477c-9106-2c1ac49eeb4e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.043923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201e72-8d06-4469-b66f-978b32168b37 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.047065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.047681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.047962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.048235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.048910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:03.049216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.050631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816185d-f7e6-4a2d-8184-a6da2a63873b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.054929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 404/809] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:03.056068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7883017-998e-4c19-9ae6-f36c439babb8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.056354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7883017-998e-4c19-9ae6-f36c439babb8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.056627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7883017-998e-4c19-9ae6-f36c439babb8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.061532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 405/810] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:03.061532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7883017-998e-4c19-9ae6-f36c439babb8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.081648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.082273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.082552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.082826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.083515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:03.083817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.085186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.096394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 406/811] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:03.097244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.163330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7883017-998e-4c19-9ae6-f36c439babb8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.190702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.198094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45575e-7417-4b7f-bd50-b789bc24fc84 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.199808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.200439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.200721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.200998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.211434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.212859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:03.227142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:03.228079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:03.229575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.235962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.236637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.236916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.237186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/050cd624409b4c269af8805835ec5f53/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.239178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=050cd624409b4c269af8805835ec5f53, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.240604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c465a-4bbe-4d12-8d2c-e39b6dba102f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.246129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.253592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 407/813] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:03 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/050cd624409b4c269af8805835ec5f53/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:34:03.254777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.255054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.255324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.275608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:03.276935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:03.342445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c77cb-9faf-4981-8d5e-71bf17d4c000 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.356260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 408/814] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:03.357136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.394169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.394813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.395099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.395543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.397112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:03.397458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.398858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.408666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 407/815] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:03.409457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.455423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.474234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11c4c1-c142-4cb9-965f-16cc59e02947 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.501787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.516483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.517140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.517438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.517915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.524738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.526822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.527451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e7a2-1876-4c22-b73d-8810463f60c0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:03.541772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:03.543285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 409/816] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:03.544182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.575524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.576153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.576432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.576695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.577387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:03.577720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.579073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.591486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 408/817] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:03.596687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.670103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9946a3-ab56-47e2-82eb-dcdfaff08b89 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.719750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.720929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.721409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.721907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] PATH_INFO: `/v3/services/network` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.722953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.725262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.728072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e68262-4cac-4bb1-87f2-f8ceaf6bfaf7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:03.741471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:03.742712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:03.743678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 410/818] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:03.744520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.760678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.773886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.774523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.774810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.775087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.776336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.778041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.787127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:03.812248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 409/819] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:03.812248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:03.914679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121fc8-07cb-4490-9201-af395eb6d402 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.967411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:03.968039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:03.968327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:03.968603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:03.969350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:03.969681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:03.971107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:03.977300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c8945-7258-48a8-a43e-e38199825007 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:03.984425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 411/820] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:03.985168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.036540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.037111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.037479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.037755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.051769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.054678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:04.070888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:04.071882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:04.073501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 410/821] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:04.075050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.093695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.139051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1945-3814-40c2-beb5-4809c5ec4904 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.164009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.186907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.187952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.188297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.188620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.189367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] RBAC: Adding query filter params (name=network) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:04.189764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.192648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.201522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 412/822] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:04.202439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.235702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183a28c-9777-4d2c-8c48-c231256abf4a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.272823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.273684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.273965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.274243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/eb10a008687543f496ff2a8ce3591bfd/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.297610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=eb10a008687543f496ff2a8ce3591bfd, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.299621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.319493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 411/823] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:04 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/eb10a008687543f496ff2a8ce3591bfd/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:34:04.321228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.347168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ff89-4ebf-4cb1-85b1-8d844e9b69bf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.408044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.420466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.421755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.422035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.422306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.423125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:04.423429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.424960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.450832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 413/824] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:34:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:04.456946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.559994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dcd23-4b1f-49ef-be36-a131e37aa5e1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.567385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.586502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3473-cb9e-432c-ad00-742618bb8491 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.615548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.616200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.616465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.616737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.617438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:04.618274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.620403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.629516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 412/825] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:04.633313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.638088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.640070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.640399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.640729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.717948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.735101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.736598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.823639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb5d7-29bd-4226-8ac1-8b00fc3a79cc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:04.849978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 414/826] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:04.856247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:04.896652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:04.897285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:04.897596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:04.897877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:04.898584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:04.899950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:04.945590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 413/827] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:04.950432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:04.968478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe77b1-1df4-4957-99fe-53be16c615ae None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.015008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.015724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.016005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.016271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.029125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.030836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:05.048593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:05.050740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:05.052842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:05.052842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:05.052842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:05.052842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:05.052842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 415/828] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:05.056033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.089088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:05.179003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c206-e3ff-474c-8587-0ab097275b7c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.216448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.217077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.217356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.217657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.218349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:05.218649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.220074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:05.237783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 414/829] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:05.240569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.346626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bfe-b5a4-4d3f-bbf6-80096b8cd074 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.382010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.382653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.382930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.383199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.385165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:05.390990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.392518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-47f87b4c-29f7-42db-85ec-daa3a52f9f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:05.404959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:05.407000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:05.409195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 416/830] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:05.412212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.501050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db9cc-afd9-4f6f-b5a5-0952e143e355 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.501050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db9cc-afd9-4f6f-b5a5-0952e143e355 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.503349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db9cc-afd9-4f6f-b5a5-0952e143e355 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.503349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 417/831] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:05.512689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:05.512847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c655-839e-4857-9b04-e04958fd462a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.512847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c655-839e-4857-9b04-e04958fd462a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.512847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c655-839e-4857-9b04-e04958fd462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.527049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821a41-d50b-44b4-936d-536042f025dd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.534555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3493c655-839e-4857-9b04-e04958fd462a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:05.535847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3493c655-839e-4857-9b04-e04958fd462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:05.581354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.582028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.582314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.582645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.583466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:05.583773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.585365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:05.598972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 415/832] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:05.606390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.618217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 418/833] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:05.642245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c655-839e-4857-9b04-e04958fd462a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.738019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f80e18-a550-4537-8440-1b9a3b9cb8b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.756026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c655-839e-4857-9b04-e04958fd462a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.781785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:05.782080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.782846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.782956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.783176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.784569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:05.785042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.786550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:05.794926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 416/834] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:05.797062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.797935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.798388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.798826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.812291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:05.817760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:05.818738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:05.819580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:05.822116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 419/835] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:05.828064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:05.842837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:05.947681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0bef-788e-4412-9939-84ccb0d36ded None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:05.987042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:05.987671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:05.987953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:05.988229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:05.988936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:05.989241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:05.990627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9140-11d5-48eb-9670-11a6710766e3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.000208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 417/836] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:06.005785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.115223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42831-405c-44b5-bb9c-c3f68d047847 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.152560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.153213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.153626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.153910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.164536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.166039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:06.182096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:06.183803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:06.185158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:06.185158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:06.185158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:06.185158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:06.185158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 420/837] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:06.189171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457737-0269-48b6-aaab-c2d5492e3e0c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.189171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457737-0269-48b6-aaab-c2d5492e3e0c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.189171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457737-0269-48b6-aaab-c2d5492e3e0c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.189171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 418/838] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:06.193061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.198146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.198486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.198928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.223024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:06.224900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:06.234722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.307561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ca9b-ee3d-489e-a7ca-002860e600c9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.313807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.319541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 419/839] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:06.343626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.348296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.349046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.349442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.349835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.350639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:06.351062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.353014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.369662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 421/840] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:06.374857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.467542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f06b0-eef6-4f24-b6de-b3fffa6159b7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.498661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.507977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ae3d6-201b-46db-a414-3a27b337b65f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.510048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.512013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.512316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.512597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.513485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.514873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:06.526883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:06.527905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:06.528824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:06.534220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 420/841] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:06.535472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.553226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.554125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.554473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.554981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.565603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.567640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:06.583460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:06.585458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:06.587352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 422/842] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:06.591313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.616030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.661738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27171-f67e-42da-a40e-fbe58bd10ecb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.698457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.699507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.699944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.700407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.701291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:06.701795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.702367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61448b6-ba06-40db-8d66-72f09b37b540 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.703706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.713932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 421/843] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:06.715126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.738995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.739551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.739834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.740109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.740937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:06.741202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.743035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.767900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:06.769307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:06.785799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4408-4dd1-45c0-976e-7a33eed6dee3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.857506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:06.866541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.867164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.867446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.867720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.868391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:06.868697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:06.870393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671062e2-23c7-4c1e-b8fd-6ef394610e7a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:06.875509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 422/845] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:06.877408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c94fc-7252-44a0-9292-f34c5b764d19 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.877870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c94fc-7252-44a0-9292-f34c5b764d19 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.878288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c94fc-7252-44a0-9292-f34c5b764d19 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.878905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a87ee-3e8d-4a11-a923-dbb24f6b4a4f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:06.884068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 423/846] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:06.887037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.887323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.887602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:06.908321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:06.909653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:06.926391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:06.927447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:06.927928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:06.928445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.001267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 424/847] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:07.025650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.027563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.029233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.052475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.148256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36210-efd6-42ab-af1b-b55a376779e1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.173317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.177542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 424/848] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 11:34:07.181978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.193709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.194469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.194871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.195249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.211177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:07.219422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:07.220533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:34:07.221369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:07.222040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 425/849] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:07.228496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.309968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1aae2-6378-4d52-907a-317c4ac4dc31 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.324892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.347646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.348289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.348568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.349044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.359673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.361120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.368198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f6a7d-d5ab-40d6-96b4-d4a726fadd1d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:07.377521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:07.378423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:07.379299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:07.379299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:07.379299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:07.379299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:07.383407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 425/850] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:07.384741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.419693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.420847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.421309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.421786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.422916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:07.424309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.425889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.443023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 426/851] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:07.444728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.498518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fbedf-29cb-4a32-a0d0-2ae320712aad None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.511642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.541446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.542437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.542939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.543582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.544493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:07.544994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.547038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.563977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 426/852] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:07.569694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.575256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464467-5b29-4006-9917-8ead3e598c25 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.599843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.613770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.614422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.614702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.614976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.627119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.628592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:07.644153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:07.645080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:07.645980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:07.645980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:07.645980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:07.645980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:07.650039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 427/853] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:07.651386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.687392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ba5-3563-4487-9a27-13901bf7ec65 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.724515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.725571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.726053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.726521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.734008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.735755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:07.748566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:07.749513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:07.750419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:07.752804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 427/854] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:07.758460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.759204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.767703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b644c1-102b-44ab-97c1-3f83a726f484 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.811633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.813001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.813381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.813817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.814685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:07.815447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.817355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.834209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 428/855] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:07.841134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.872935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:07.889822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d5ea0-a94a-4fec-8ccf-a31093fbd381 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:07.930340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:07.931251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:07.931543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:07.931822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:07.933435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:07.933867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:07.936161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:07.957502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 428/856] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:07.959844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:07.960682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c7b8d-7996-4a49-a7ac-3d888f50016a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.002888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.003537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.003816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.004092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.011520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.012969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-64ef562c-b878-4851-8ca9-b69db4e487a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:08.025465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:08.027371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:08.028319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:08.031787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 429/857] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:08.033179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dd92-5b1b-408a-b462-b4967809d65e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.033494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dd92-5b1b-408a-b462-b4967809d65e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.033777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dd92-5b1b-408a-b462-b4967809d65e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.036449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 430/858] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:08.037323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3dd92-5b1b-408a-b462-b4967809d65e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.059617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.086798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49541087-af93-4917-a9aa-b92c1c54e6f9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.125222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.125865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.126140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.126415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.127196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=050cd624409b4c269af8805835ec5f53) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:08.127507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.128948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d14d3b-4926-46b8-b7c7-8cb6511acbd7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.142636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 429/859] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:07 2022] GET /identity/v3/role_assignments?user.id=050cd624409b4c269af8805835ec5f53&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:08.142636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.142636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.142636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.158016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:08.160045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:08.162669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3dd92-5b1b-408a-b462-b4967809d65e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.163587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.208254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.208894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.209175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.209473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.210286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:08.210586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.212306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.236934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 431/860] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:08.238464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.262106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 430/861] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:08.284527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.330304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.370974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ee034-661b-4a4e-97c2-c44b99585630 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.417973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.418755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.418896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54892e8b-e91d-4e57-a572-5bb6e3766f17 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.419238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.419632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.462467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.463425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.463959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.464539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.466031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.466999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:08.482009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:08.483028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:08.483872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:08.491152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 431/862] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:08.492986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.499495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.516814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.522943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.624357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.629971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f549-bb93-4b70-b541-a1a74ac8933d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.661545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 432/863] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:08.663534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.679702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.680728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.681214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.681762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.682894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:08.683526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.685178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.690912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:08.696454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.781524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11e30-6bd3-4bdd-baad-56bd691a455c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.788970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.820592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.821704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.822285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.822814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.834343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2d11-583f-4fec-84a3-91c9d8d3308f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.835438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.837299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:08.854782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:08.855760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:08.856630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:08.856630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:08.856630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:08.856630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:08.863263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:08.864401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:08.873885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:08.874587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.874787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.875049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.875730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:08.876034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:08.877925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc5fdd-3c31-43c9-a377-103a2a1bf015 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:08.885500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 433/866] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:08.904776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:08.955906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555aca-a534-47bd-ad20-2473e81a7386 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.956537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555aca-a534-47bd-ad20-2473e81a7386 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.957016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555aca-a534-47bd-ad20-2473e81a7386 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.959119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 434/867] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:08.967203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:08.967959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:08.968624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:08.992656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae4f1e-ee56-4854-9993-3f009cef7162 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:08.994327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:08.996416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:09.036515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:09.037146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:09.037469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:09.037730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:09.038425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:09.038734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:09.040137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:09.058932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 434/868] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:09.060859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:09.087148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 435/869] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:09.110089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:09.173354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:09.195885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:09.201587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c0ec-c544-43eb-927a-95055dcfbf2d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:09.242404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:09.244024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:09.244906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:09.245440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:09.246886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9a61-e125-4f87-be48-437a1d0276da None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:09.255031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:09.257217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:09.274572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:09.275495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:09.276451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:09.283512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:09.284632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:09.293467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:09.294118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:09.294414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:09.294674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:09.295373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:09.296756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:09.316306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 436/871] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:09 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:09.420420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298aab1-341d-42ff-b668-77c802fd4423 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:09.466140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:09.466875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:09.467174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:09.467450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:09.468203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:09.468515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:09.470042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343731-59a6-4f7a-bdbd-4743eb1ae8bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:09.485064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 436/872] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:09.490664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:09.601125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dc9de-7eb9-4386-911c-3df0c335e477 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:09.625564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:09.639718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:09.640358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:09.640635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:09.640907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:09.641727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=eb10a008687543f496ff2a8ce3591bfd) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:09.642040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:09.643479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853463-1f82-4f52-99d0-d91c1f15550b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:09.650099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 437/873] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:09 2022] GET /identity/v3/role_assignments?user.id=eb10a008687543f496ff2a8ce3591bfd&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:10.267864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66abd-0d5c-41d5-9adc-3edf8862893c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:10.268384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66abd-0d5c-41d5-9adc-3edf8862893c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:10.268476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66abd-0d5c-41d5-9adc-3edf8862893c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:10.270016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 437/874] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:10.275291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:10.275737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:10.275930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:10.294172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:10.295359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:10.364485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 438/875] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:10.386407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d66abd-0d5c-41d5-9adc-3edf8862893c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:10.389847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:10.510506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d66abd-0d5c-41d5-9adc-3edf8862893c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:10.547892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:10.549180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:10.549687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:10.550175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:10.550987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:10.552715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:10.562586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:10.563531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:10.564377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:10.566996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 438/876] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:10.577468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:10.680866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9b1dd-a92c-426c-8488-e3dc7b2a2403 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:10.698455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:10.716961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:10.717626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:10.718149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:10.718713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:10.719399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:10.719707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:10.721146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8eba-0abc-4435-826a-45663b7903f6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:10.726262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 439/877] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:10.732630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:10.810791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:10.849891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a789f2-84e7-48dd-aec5-11e075577429 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:10.888729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:10.889480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:10.889772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:10.890050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:10.890756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:10.891064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:10.892490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab457fb-5f7c-4516-ac4d-3075ab0d1c14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:10.898367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 439/878] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:11.034236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4a1d-dc8f-4245-a357-0ba1f24837e0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.034629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4a1d-dc8f-4245-a357-0ba1f24837e0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.034854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4a1d-dc8f-4245-a357-0ba1f24837e0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.036499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 440/879] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:11.042011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fdae6-aaf3-40c5-b067-b0a7932676ce None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.042488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fdae6-aaf3-40c5-b067-b0a7932676ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.042595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fdae6-aaf3-40c5-b067-b0a7932676ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.063239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2a7fdae6-aaf3-40c5-b067-b0a7932676ce None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:11.064354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2a7fdae6-aaf3-40c5-b067-b0a7932676ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:11.134642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 440/880] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:11.158259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c4a1d-dc8f-4245-a357-0ba1f24837e0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:11.271190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c4a1d-dc8f-4245-a357-0ba1f24837e0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:11.308352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:11.308978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.309249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.309553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.310256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:11.311679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce713a5-2469-47f9-a13e-9393f589dd4e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:11.329704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 441/881] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:11 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:11.495376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2590a-ac8d-4687-9595-e3ad3086a5b1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.495900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2590a-ac8d-4687-9595-e3ad3086a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.495900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2590a-ac8d-4687-9595-e3ad3086a5b1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.497564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 441/882] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:11.502776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.503073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.503360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.523740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:11.525047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:11.562352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:11.603283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 442/883] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:11.626014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2590a-ac8d-4687-9595-e3ad3086a5b1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:11.690351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:11.736723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2590a-ac8d-4687-9595-e3ad3086a5b1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:11.780305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:11.783494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.784017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.784493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.785329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:11.786926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-70864b87-3a74-40a8-bba7-96543022be03 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:11.797351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:11.798365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:11.799195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:11.802055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 442/884] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:11.813460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:11.851914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f616a-fb2e-4bc2-8020-b40950d83e75 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.852289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f616a-fb2e-4bc2-8020-b40950d83e75 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.852492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f616a-fb2e-4bc2-8020-b40950d83e75 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.854717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 443/885] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:11.859622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.859909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.860189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.882654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:11.883919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:11.919811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc546-607c-4ff0-8eda-69670dd7f571 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:11.955818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:11.956444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:11.956726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:11.957001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:11.957768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:11.958079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:11.959450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:11.965294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 443/886] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:11.970899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:11.985507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 444/887] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:12.002753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.004527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.066047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.102989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4384c9-55ad-4679-be5a-aeb77d4efd44 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.116327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e886d-356b-4f3d-af6e-df50937eabca None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.144827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.145933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.146496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.146978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.147870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:12.148478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.150188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.154442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.155121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.155389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.155649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.162034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 444/888] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:12.164440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.167272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:12.172405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:12.173352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:12.174218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:12.178621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 445/889] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:12.179804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.272777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.281012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506809b-1c1b-4f67-a462-7a414d25dca7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.284997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d96ad-f9e9-47a1-9e07-e587e3f03b74 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.299669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.320799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.321304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.321789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.322171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.322456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.323152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.323736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.324057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:12.324334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.324542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.325396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] RBAC: Adding query filter params (interface=public, service_id=445101ba546740bca20d836774f246d6, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:12.325875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.326216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.327657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.337772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 445/890] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/endpoints?service_id=445101ba546740bca20d836774f246d6&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:12.339372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 446/891] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:12.339784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.340237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.444092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d54d-0930-437d-9d1e-87ef2b6f8a6b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.450915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45b3d-d297-41b6-b66c-d662c4f82feb None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.480775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.481438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.481746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.482061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.491699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.492598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.493105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.493294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.493800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.494775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.495094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.496775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.509862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 446/892] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:12.514937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:12.516231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:12.517119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:12.517119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:12.517119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:12.517119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:12.517119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 447/893] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:12.522537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.554063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.634553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4a7c2-7390-4b2d-93ec-2c98f42e958e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.673156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.673828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.674111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.674454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.675164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:12.675467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.676868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.690618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 447/894] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:12.696267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.727132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.803383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080cc47-454a-4a72-9168-5d4f2846eefe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:12.840385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:12.841033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:12.841316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:12.841623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:12.849647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:12.851232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:12.862771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:12.863717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:12.864631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 448/895] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:12.870485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:12.958131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:12.977210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8359-f650-43a0-bd37-290d7d7586b3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.013322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.014247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.014524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.014798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.015599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:13.015907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.017439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b568-86e6-40c7-b22d-287848d57645 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.036252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 448/896] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:34:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:13.042556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.046973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ada1-e1b7-4546-aa90-fe83c6348c4e None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.047259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ada1-e1b7-4546-aa90-fe83c6348c4e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.047538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ada1-e1b7-4546-aa90-fe83c6348c4e None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.049011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 449/897] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:13.054099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.054392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.054665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.074460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:13.075654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:13.154046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.154238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 450/898] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:13.167191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22f951-51b8-4076-9420-c152abed08ed None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.181364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.208760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.209317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.209629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.209909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.277802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.300801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.302418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.317857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18b024-f7eb-4625-8195-afa42a8bb4f7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.363153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.364837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.365322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.365851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.366748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.368363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c6a5-b0cb-4f15-9f0c-79fec5b1ddda None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.386114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 451/899] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:13 2022] POST /identity/v3/services => generated 241 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:34:13.413897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.421023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f678a6-791b-4f81-86ff-dd8d1818659a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.421938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f678a6-791b-4f81-86ff-dd8d1818659a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.422459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f678a6-791b-4f81-86ff-dd8d1818659a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.424488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 452/900] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:13.429158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 449/901] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:13.430551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.431092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.431609 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.432691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.458142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:13.460516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:13.551678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b14b-0296-4b60-a4c7-e9d29be7044b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.558311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 453/902] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:13.581175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.598178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.598596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.598878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.599153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.614387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.615829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:13.636260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:13.637500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:13.638922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:13.638922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:13.638922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:13.638922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:13.638922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 450/903] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:13.642177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.669578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.700985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d7b1-7bce-4a23-b2d7-f2502cdd6c9b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.709654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.746699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.747287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.747564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.747837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.748482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.750706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:13.761213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:13.763005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:13.764113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 454/904] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:13.769519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.781980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf734-f632-4098-b5dc-6199f9fdc944 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.823982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.824720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.825071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.825528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.826688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:13.827171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.828870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.845499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 451/905] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:13.847618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:13.912647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786009d-b7d3-4fb1-9744-14e736b82e4f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.941200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.954112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:13.958000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d6c-cb5c-4787-8c2f-bdf2d2804082 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:13.966101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:13.967682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:13.968147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:13.968614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:13.969981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:13.970603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:13.972820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:13.985041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 455/906] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:13.985734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.001844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.002474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.002807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.003087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.011384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.013142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:14.026132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:14.027041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:14.027908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:14.032218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 452/907] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:14.033287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.120851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72893ed0-8c0d-4326-af98-270524ceda57 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.145655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff910-76b1-4644-8310-436c7ee94354 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.162770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.163526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.163731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.164006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.164688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:14.164988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.167182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.173456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 456/908] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:14.180332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.198930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.199952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.200413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.201044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.202071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:14.202608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.204480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.220691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 453/909] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:14.226600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.247748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:14.255972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:14.311496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaa07-2f5f-42e3-8622-cccc38038b5b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.344682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571f9d-6bdf-4985-9bdc-a60ecf44f1e5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.352952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.353598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.354485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.354754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.355995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] RBAC: Adding query filter params (interface=public, service_id=d834582a93a84d5295fb83d5314d3464, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:14.356306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.357735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.369577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 457/910] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/endpoints?service_id=d834582a93a84d5295fb83d5314d3464&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:14.370468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.390552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.391542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.392071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.392561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.393836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] RBAC: Adding query filter params (role.id=38656cf884084e6db7d1c919c3f55d05, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=eb10a008687543f496ff2a8ce3591bfd) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:14.394352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.396006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf79e5-bea8-4175-b768-d469f8b36360 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.409763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 454/911] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/role_assignments?user.id=eb10a008687543f496ff2a8ce3591bfd&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=38656cf884084e6db7d1c919c3f55d05 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:14.484637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5624b5-0889-4f06-857f-2499472d247a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.499189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:14.522911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.523464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.523740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.524013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.524669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.526727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5ccc-b90d-42cc-b74a-b5165067ce70 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.533895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 458/912] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:34:14.678963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114091b3-f6ff-48dc-b066-057851d8e4c3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.679484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114091b3-f6ff-48dc-b066-057851d8e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.679593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114091b3-f6ff-48dc-b066-057851d8e4c3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.681076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 455/913] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:14.687603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.687893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.688176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.707454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:14.708641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:14.782467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 459/914] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:14.805495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114091b3-f6ff-48dc-b066-057851d8e4c3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:14.897128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:14.915037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114091b3-f6ff-48dc-b066-057851d8e4c3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:14.951714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:14.952364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:14.952645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:14.952921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:14.953626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:14.955042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:14.964704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:14.965724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:14.966554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 456/915] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:14.972014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:15.083633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a90a8f-9158-4d2f-9d23-310a46080b6a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:15.091265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:15.120020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:15.120656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.120932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.121205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.121934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:15.122240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:15.123624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:15.129111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 460/916] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:15.134883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:15.241775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e886-71e0-4826-a748-09add67dafd0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:15.278012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:15.278997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.279542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.280052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.280961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:15.281478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:15.283045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5670c-8fa5-4ea3-9055-434756f2725b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:15.288426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 457/917] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Jul 29 11:34:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:15.294823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:15.400423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b960e3c-501e-4b10-83fc-37ae9f8e2219 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:15.436955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:15.437608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.437892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.438167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.438879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:15.440252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d387b-c2f2-4c34-b43c-8b518c8fda38 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:15.466023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 461/918] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:15.525572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4f0d-273e-4abe-943f-13cfe9b32aca None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.526493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4f0d-273e-4abe-943f-13cfe9b32aca None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.526671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4f0d-273e-4abe-943f-13cfe9b32aca None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.528325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 458/919] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:15.534254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.534561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.534867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.555472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:15.556784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:15.580698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:15.644729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 462/920] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:15.668327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4f0d-273e-4abe-943f-13cfe9b32aca None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:15.686017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:15.790934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4f0d-273e-4abe-943f-13cfe9b32aca None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:15.828273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:15.829247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.829708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:15.830234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:15.831046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:15.832557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:15.843013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:15.844217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:15.845267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:15.847722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 459/921] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:15.856031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:15.958649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9763116-472d-4fbf-b0cc-05e968d05495 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:15.998299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:15.999288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:15.999775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.000270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.001212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:16.001749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:16.003346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:16.009102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 463/922] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:16.015222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.102887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:16.129199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7920-54d1-47a9-9eda-1da2d336acdd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.165688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:16.166850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.167126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.167451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.168213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:16.168521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:16.169937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:16.175553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 460/923] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:16.188696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.205743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:16.295518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaee22-2593-421d-9a7e-cc61606254f5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.331743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:16.332781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.333221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.333684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.334601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] RBAC: Adding query filter params (interface=public, service_id=9dc36db4c7b341fb902eec2151a09db1, region_id=RegionOne) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:16.335074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:16.336606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28178-9b98-4627-b6ec-68a279560aec None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:16.342905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 464/924] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/endpoints?service_id=9dc36db4c7b341fb902eec2151a09db1&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:16.351279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.456747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88250abd-5933-4234-877d-bd57dd378c76 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.492968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:16.494009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.494656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.495149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.496062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:16.497672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a924-9f89-4f08-89ca-b46e5ef6520d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:16.504332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 461/925] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:34:16.537250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6190f-8e5e-4df7-9d48-4ad1a454caad None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.537821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6190f-8e5e-4df7-9d48-4ad1a454caad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.537821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6190f-8e5e-4df7-9d48-4ad1a454caad None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.539284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 465/926] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:16.545672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db909-7208-4677-8b72-26376203b67b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.545859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db909-7208-4677-8b72-26376203b67b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.546147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db909-7208-4677-8b72-26376203b67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.553905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:16.566276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-276db909-7208-4677-8b72-26376203b67b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:16.567516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-276db909-7208-4677-8b72-26376203b67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:16.645985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 462/927] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:16.668794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6190f-8e5e-4df7-9d48-4ad1a454caad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.677525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e843be-6487-40e6-81d9-8cc33e82499c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.677816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e843be-6487-40e6-81d9-8cc33e82499c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.678089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e843be-6487-40e6-81d9-8cc33e82499c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.679590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 463/928] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:16.685555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.685847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.686235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.705088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:16.706307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:16.782677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:16.806285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6190f-8e5e-4df7-9d48-4ad1a454caad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.807779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 464/929] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:16.830213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.845454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:16.846110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.846395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.846671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.859975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:16.866744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:16.867721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:16.868851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 466/930] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:16.874247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:16.908461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:16.948205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a8f14-5eb2-4130-81d2-216165bdda67 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.984403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:16.985057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:16.985342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:16.985665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:16.986282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:16.987712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:16.989873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd944b0f-e79b-4128-9946-0f9fe6a31f06 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:16.996826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:16.997882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:16.999150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 465/931] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:17.005045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.033966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.035410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.035906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.036389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.037434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:17.038039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.039615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.049121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 467/932] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:17.057553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.058214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.125338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567bf3-b838-4389-85dc-3c198200423d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.165052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.173978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e772e9-b900-42ff-af31-bc6a61a1596b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.175301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.176261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.177516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.177946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.178831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:17.179277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.180797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.188317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 466/933] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:17.194387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.217476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.218457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.219000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.219544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.231603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.233680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:17.250102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:17.251056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:17.251946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:17.251946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:17.251946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:17.251946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:17.254051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 468/934] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:17.259767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.316698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18e60-25ae-4144-add8-463467b65848 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.331206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.363187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.364298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.364751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.365338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.366491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:17.366963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.368468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.380131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 467/935] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:17.381193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.391228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953995-733e-487b-a5f0-9d677dae88e2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.434307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.435647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.436385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.436891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.437978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:17.438757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.440327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.445021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.460841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 469/936] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:17.461977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.499424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f10e-daf3-4945-95e5-9a5d21080713 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.537232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.537897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.538182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.538458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.539166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.540734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d46ff-ea2b-44c0-ae11-31e59632fe18 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.565448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 468/937] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:17.592815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211894f-8a52-4c04-bdbe-2157953cac32 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.610669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.644008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.645174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.645732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.646229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.656864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.658812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:17.673649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:17.674721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:17.675663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:17.678976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 470/938] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:17.679781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6595a-da2d-4330-b3dc-87d4def7d773 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.680043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6595a-da2d-4330-b3dc-87d4def7d773 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.680323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6595a-da2d-4330-b3dc-87d4def7d773 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.685467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 469/939] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:17.686995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.687734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.688168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.688346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.713240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:17.714595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:17.806094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 470/940] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:17.818449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb056-84ee-4349-b28d-337fff456acf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:17.828625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.857593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:17.858312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:17.858696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:17.859071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:17.860320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:17.860320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:17.861915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:17.884757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 471/941] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:17.887172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:17.892459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.924573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:17.960552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517062a1-a2d2-4b17-aa78-64b49ece2c3b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.006450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dec1f-9a7f-4611-80c9-17791dfeeaa1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.010429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.011070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.011347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.011619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.012312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.014102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.017374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING keystone.server.flask.common [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 29 11:34:18.040744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 11:34:18.040744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 11:34:18.040744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [parameters: {'id': '0ee1d8311e0f41478141c9400c184d8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 11:34:18.040744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 11:34:18.049242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.049904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.050181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.050454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ee1d8311e0f41478141c9400c184d8e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ee1d8311e0f41478141c9400c184d8e. Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:34:18.051208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 29 11:34:18.052011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 29 11:34:18.052960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 11:34:18.053910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 11:34:18.054811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:34:18.055621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'id': '0ee1d8311e0f41478141c9400c184d8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.057887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:18.059728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ee1d8311e0f41478141c9400c184d8e. Jul 29 11:34:18.061982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.063137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.063137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.069939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 471/942] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Jul 29 11:34:17 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:18.071407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:18.079730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:18.080707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:18.081619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:18.081619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:18.081619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:18.081619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:18.086244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 472/943] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:18.087127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.194718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:18.207950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:18.215534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667830-0632-4556-87d6-cc0869af22ca None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.220007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283365f0-41d3-40b6-a8fe-6a68778ae1dd None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.254740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.255810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.256295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.256846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.260076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.260699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.260979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.261250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.261969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:18.262269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.263890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.266908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.268769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.276084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 473/944] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:18.281734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:18.282622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:18.283524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:18.283962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.290878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 472/945] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:18.292542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.389775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54e98f-22a2-4811-af4d-371e58a20ae2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.408006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284431b8-c8e4-4198-9e02-1519ff003e02 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.425252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.425920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.426256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.426464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.433353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.434814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.437341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:18.446811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:18.448465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:18.449502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:18.453674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 474/946] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:18.454103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.454509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.455326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.455901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.456407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.457511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:18.458124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.459827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.489823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 473/947] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:18.564135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ccc0a-c22c-4c85-8bd2-f5e046c9a494 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.601434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.602090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.602340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.602602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.603359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:18.603702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.605664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82200ac-67d1-41ea-be69-d5a40cb368b6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.620042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 475/948] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:18.626049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.646378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99454c-3e3b-409a-9891-80735945b8a4 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.646764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99454c-3e3b-409a-9891-80735945b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.646953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99454c-3e3b-409a-9891-80735945b8a4 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.648515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 476/949] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:18.652404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:18.655709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.656007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.656285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.676166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:18.677360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:18.742533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:18.759572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b0d5-3e57-487b-971f-e7344c281904 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.766000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 477/950] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:18.788127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:18.801364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.802247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.802625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.802966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/eb10a008687543f496ff2a8ce3591bfd/roles/38656cf884084e6db7d1c919c3f55d05` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.805613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=eb10a008687543f496ff2a8ce3591bfd, role_id=38656cf884084e6db7d1c919c3f55d05)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.807704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.829870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 474/951] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:18 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/eb10a008687543f496ff2a8ce3591bfd/roles/38656cf884084e6db7d1c919c3f55d05 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:34:18.911416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d7d1-1516-49cc-9b65-ed1d5de226d6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:18.951293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:18.952300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:18.952781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:18.953248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:18.954169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:18.955795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:18.966198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:18.967261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:18.968090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:18.975346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 478/952] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:18.977155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:19.062547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:19.086132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470445-2a8a-4fc1-baf4-b12197922867 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:19.121405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:19.122061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:19.122341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:19.122617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:19.123295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:19.123601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:19.124976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:19.134800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 475/953] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:19.136223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:19.197997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:19.245255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8a2d-6dab-4611-bbdf-89b56b196968 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:19.281073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:19.281748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:19.282032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:19.282304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:19.283041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:19.283344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:19.284777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2f905-a74f-4418-b01d-69a29d14a8f1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:19.293496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 479/954] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:19.296201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:19.401695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25100a5-8f2c-4328-a46a-12cb38ea95b0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:19.437582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:19.438577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:19.439077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:19.439597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:19.440497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:19.442069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c38bc-768f-496f-858f-fde0a29e361c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:19.457447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:19.464769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 476/955] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:19.724874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553519-37ec-4afa-9e3e-7b2ef9a9d7bf None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:19.725438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553519-37ec-4afa-9e3e-7b2ef9a9d7bf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:19.725438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d553519-37ec-4afa-9e3e-7b2ef9a9d7bf None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:19.727032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 480/956] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:19.732349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:19.732645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:19.732926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:19.751838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:19.753446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:19.832481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 477/957] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:19.854002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d553519-37ec-4afa-9e3e-7b2ef9a9d7bf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:19.960025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d553519-37ec-4afa-9e3e-7b2ef9a9d7bf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:19.982643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:20.000319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:20.000962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:20.001243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:20.001551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:20.002177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:20.003710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:20.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:20.014804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:20.015694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 481/958] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:20.021315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:20.131211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83285-1fd4-43e5-9e70-9bf16c6a4c8d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:20.156211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:20.167383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:20.168072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:20.168353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:20.168622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:20.169296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:20.169623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:20.170988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c4db-839a-45cf-a475-a9189a71afe2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:20.176239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 478/959] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:20.191250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:20.297384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e247-4f4e-4cc4-b083-c8336460def6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:20.336934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:20.337586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:20.337874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:20.338274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:20.339056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:20.339366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:20.340740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36debb32-0b52-4314-8ef7-46f3d8d5fc94 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:20.345776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 482/960] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:20.717959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5f8-2ed6-407b-8eb8-b051ee241f81 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:20.718456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5f8-2ed6-407b-8eb8-b051ee241f81 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:20.718856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5f8-2ed6-407b-8eb8-b051ee241f81 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:20.720574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 479/961] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:20.725774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d743a-10a0-4eea-aac4-44c5ff96bff1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:20.726218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d743a-10a0-4eea-aac4-44c5ff96bff1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:20.726524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d743a-10a0-4eea-aac4-44c5ff96bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:20.745149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cd7d743a-10a0-4eea-aac4-44c5ff96bff1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:20.746392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cd7d743a-10a0-4eea-aac4-44c5ff96bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:20.793047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:20.825287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 483/962] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:20.849365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfd5f8-2ed6-407b-8eb8-b051ee241f81 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:20.962217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfd5f8-2ed6-407b-8eb8-b051ee241f81 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.002211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729947-1115-4895-9806-12b272818622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.002745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729947-1115-4895-9806-12b272818622 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.003021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729947-1115-4895-9806-12b272818622 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.003291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a729947-1115-4895-9806-12b272818622 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.003966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a729947-1115-4895-9806-12b272818622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.005498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a729947-1115-4895-9806-12b272818622 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.022167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-4a729947-1115-4895-9806-12b272818622 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 11:34:21.022167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 11:34:21.022167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [parameters: {'user_id': '73f58fa6752e4237beba5e08978799f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 11:34:21.022167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4a729947-1115-4895-9806-12b272818622 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:34:21.029467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:34:21.030360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 11:34:21.031303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 11:34:21.032202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 11:34:21.034170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 11:34:21.035971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'user_id': '73f58fa6752e4237beba5e08978799f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:21.037036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 29 11:34:21.038082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.039294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 480/963] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Jul 29 11:34:20 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:21.041511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ded1-a8e4-4a81-b424-dbebd7243582 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.041954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ded1-a8e4-4a81-b424-dbebd7243582 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.042387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ded1-a8e4-4a81-b424-dbebd7243582 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.042950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729947-1115-4895-9806-12b272818622 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.048012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 484/964] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:21.049727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.050164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.050611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.070860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:21.072311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:21.110188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.169372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a729947-1115-4895-9806-12b272818622 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.169642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 485/965] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:21.200936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.207113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.207888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.208277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.208655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.216577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.218367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:21.231169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:21.232335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 11:34:21.233504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.235354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 481/966] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:21.240989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.315253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e08e5b-e27d-4b0f-af6e-713dd2c6b65c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.323324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.348292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a853b4-8fd4-4584-8d88-3099b26f21ad None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.354384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.355219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.355782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.356210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.361469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.367516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:21.373430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:21.374546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:21.375578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:21.382367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 486/967] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:21.383962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.392503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.393263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.393688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.394092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.394971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:21.395392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.396930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4beb89-218c-4796-ac02-711e7cc982ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.445616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 482/968] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:21.504835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204840c-c868-4c7f-8419-d6a16a852c07 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.549986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.550871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.551301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.551744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.552616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:21.553069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.554652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.569524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 487/969] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:21.569723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d00e-c2bb-44c9-9700-9da820890e31 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.569723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d00e-c2bb-44c9-9700-9da820890e31 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.569723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d00e-c2bb-44c9-9700-9da820890e31 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.571571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.571708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 483/970] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:21.577189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.577517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.577802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.598323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:21.599926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:21.605613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.689522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 484/971] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:21.698791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c98764-5a72-4342-aed9-0a27e304d8b6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.712461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.739932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.740653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.740942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.741222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.753913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.755372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:21.770671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:21.771568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:21.772465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:21.772465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:21.772465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:21.772465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:21.772465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 488/972] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:21.778124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.832249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.836272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb577a4f-3a8d-47bf-8590-4d3a8a764ce7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.878327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:21.879596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.880047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.880279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.880550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.881317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.882582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:21.892770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:21.893840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:21.894659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 485/973] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:21.899751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:21.907817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d837518-6a2b-479b-9cd2-48cf6442889a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:21.944451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:21.945134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:21.945377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:21.945643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:21.946520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:21.946636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:21.948658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:21.961330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 489/974] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:21.967255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.006930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d245-1781-469a-acc8-5b27757d66c5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.044966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.045779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.046196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.046535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.047739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:22.047739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.049058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.054612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 486/975] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:22.059909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.085374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bdb0a-d627-406a-937a-8155158f446a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.092690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.129499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.130157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.130438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.130715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.137943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.139649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.142269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:22.153014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:22.154196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:22.155430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 490/976] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:34:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:22.160208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.181712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be751-2f84-4171-824c-2fe16ac65275 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.219068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.219692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.219972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.220246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.221031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:22.221367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.222757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.227947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 487/977] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:22.234202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.274589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfb20-ade5-4d38-867c-44a51d522157 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.310900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.311515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.311805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.312072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.313059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:22.313362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.314820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.333164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 491/978] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:22.334302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.339688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.345896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4632e61-aca0-45b0-b592-7f3adf78492c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.385253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.386087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.386468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.386851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.387619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] RBAC: Adding query filter params (interface=admin, service_id=9dc36db4c7b341fb902eec2151a09db1, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:22.387932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.389708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23e62f-6acd-4ae8-a2d3-27707e9cafb7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.397335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 488/979] 10.222.0.60 () {56 vars in 1249 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/endpoints?service_id=9dc36db4c7b341fb902eec2151a09db1&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:22.401405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de6867-8977-4467-a3ed-a526fc6cf81f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.401726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de6867-8977-4467-a3ed-a526fc6cf81f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.401997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de6867-8977-4467-a3ed-a526fc6cf81f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.403257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 489/980] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:22.403943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de6867-8977-4467-a3ed-a526fc6cf81f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.406220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.446951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a4f8-3bb1-43c9-9a9b-1c6e20996cf8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.480933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.481591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.481879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.482158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.502901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de6867-8977-4467-a3ed-a526fc6cf81f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.536632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.537244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.537560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.537837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.538479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.539839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44b7b1-bda9-4ce2-af78-4ab4f881eb9b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.546393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 490/981] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:34:22.561029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.561029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.561029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.561333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.561333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.568039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:22.569290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:22.584157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.618043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:22.652579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 491/982] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:22.674901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.680556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:22.682470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.792256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2808118-2fff-4d7b-a89b-2a1867191192 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.794717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aba2-d1ee-4554-bdd1-2730a531375f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:22.828671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.829709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.830075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:22.830408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.830714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:22.830993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:22.831231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.831343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:22.832191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.833969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.842270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:22.843753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:22.861445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 492/984] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:22 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:22.869490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:22.870679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:22.871986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:22.871986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:22.871986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:22.871986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:22.873802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 493/985] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:22.876381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:22.889365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:23.000517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3132d-3f23-4859-a86b-f18b8354e6b5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:23.039263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:23.039896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:23.040176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:23.040449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:23.041191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:23.041524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:23.042997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:23.055604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 493/986] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:23.061815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:23.074718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:23.166732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3784f-e2c3-4551-ba2e-c0b503960b30 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:23.207131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:23.207784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:23.208065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:23.208338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:23.215240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:23.216680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:23.228126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:23.229056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:23.230130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:23.231192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 494/987] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:23.235670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:23.301307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:23.342214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ba1d-fe03-4a96-be30-4971a40399cb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:23.376393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:23.377019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:23.377300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:23.377615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:23.378353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:23.378659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:23.380078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c7e4-4602-46fb-998c-2ff120d18d85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:23.392480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 494/988] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:23.398227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:23.468049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:23.499723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c92c8-dddd-49ac-95ce-16f4b599d7df None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:23.534319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:23.534936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:23.535220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:23.535490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:23.536267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] RBAC: Adding query filter params (role.id=38656cf884084e6db7d1c919c3f55d05, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=eb10a008687543f496ff2a8ce3591bfd) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:23.536573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:23.538029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809611ac-eb86-405f-a0f8-80e08aae1531 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:23.549451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 495/989] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:23 2022] GET /identity/v3/role_assignments?user.id=eb10a008687543f496ff2a8ce3591bfd&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=38656cf884084e6db7d1c919c3f55d05 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:24.572627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3be0-2d54-499d-8b91-5a2d88dd07cd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:24.573125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3be0-2d54-499d-8b91-5a2d88dd07cd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:24.573407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3be0-2d54-499d-8b91-5a2d88dd07cd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:24.574793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 495/990] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:24.579958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:24.580350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:24.580530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:24.599028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:24.600210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:24.668289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 496/991] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:24.690843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3be0-2d54-499d-8b91-5a2d88dd07cd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:24.795834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3be0-2d54-499d-8b91-5a2d88dd07cd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:24.819135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:24.831511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:24.832093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:24.832374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:24.832649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:24.833268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:24.834665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-70a1d1ac-089f-49dc-a287-bc3e563291ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:24.844334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:24.845436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 11:34:24.846281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:24.849727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 496/992] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Jul 29 11:34:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:24.851464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:24.892057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f7ff-f056-4a44-a6ae-e161268bb679 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:24.892362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f7ff-f056-4a44-a6ae-e161268bb679 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:24.892631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f7ff-f056-4a44-a6ae-e161268bb679 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:24.894137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 497/993] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:24.898775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:24.899065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:24.899346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:24.914755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:24.918204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:24.919393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:24.955968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3c1c1-6099-40c5-8dd5-c5e91c88b585 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:24.993456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 498/994] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:25.000444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.001276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.001773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.002223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.003068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:25.003545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.005094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.011338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 497/995] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:25.013196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.016907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.118175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d9ee-3146-492f-adc2-41eded140c1e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.125338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca23345-2f62-4bbc-9c9e-cda30af677a5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.144689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.146752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.156132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.156758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.157043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.157317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.158030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:25.158336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.159708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.164438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 498/996] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:25.170511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.170758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.171176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.171455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.171733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.172368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.176834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:25.186704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:25.187796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:25.188629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 499/997] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:25.193743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.284128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265e147-9fdc-4e08-8431-cdd1e16713f7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.300920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56997-3932-4a2f-903e-32932b91621a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.319167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.319786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.320067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.320340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.321055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.323050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.339185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.339813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.340100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.340380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.341061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:25.341525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.341938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 499/998] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:34:25.342765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.357479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 500/999] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:25.360387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.418966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.478377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44c76-18f4-455f-b84f-412c2a9c4025 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.517112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.517792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.518077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.518355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.519361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:25.519361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.520837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c832-0b4f-4579-90dd-74c18eb6b1e9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.527485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 500/1000] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:25.533498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.583441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.598988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383acd-eb52-41c8-976b-bec1d2a5e6e6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.599494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383acd-eb52-41c8-976b-bec1d2a5e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.599602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383acd-eb52-41c8-976b-bec1d2a5e6e6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.600860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 501/1001] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:25.606715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.607063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.607338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.625931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:25.627141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:25.647116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd6621-b6f6-4abc-b3f3-30f4c6eccee4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.686380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.687005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.687288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.687561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.688309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] RBAC: Adding query filter params (interface=public, service_id=5c84c02915664e15af3d58694849ebe5, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:25.688625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.690024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.695390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 501/1002] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/endpoints?service_id=5c84c02915664e15af3d58694849ebe5&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:25.701272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.709544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 502/1003] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:25.726911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:25.771653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.809526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d999-5bcc-42fa-bd93-ca440cad4250 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.821105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:25.841975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddccf09-785a-4ea7-bd41-d6b3ad5a119d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:25.849179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.849857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.850143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.850422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.851077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.852457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.860400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 502/1004] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:34:25.892667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:25.893688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:25.894187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:25.894646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:25.895487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:25.897100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:25.907918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:25.908992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:25.909880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:25.912027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 503/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:25.918362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:26.037732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3817-100b-4c30-85a6-aa138155fe23 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:26.071826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:26.073047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:26.073330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:26.073626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:26.074300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] RBAC: Adding query filter params (name=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:26.074601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:26.075959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099822b6-89bc-4845-a757-53dac28f8688 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:26.081156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 503/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:26.087043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:26.196599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f580-9d04-4ec6-98e8-e553858371a9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:26.204595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:26.232297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:26.232914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:26.233190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:26.233478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:26.234141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] RBAC: Adding query filter params (type=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:26.234439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:26.235796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ffd7-bcaa-4f85-b917-9e949d4701dd None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:26.240349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 504/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:27.396601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100faeaa-3f37-46a5-a88a-1e632a149273 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.397111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100faeaa-3f37-46a5-a88a-1e632a149273 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.397215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100faeaa-3f37-46a5-a88a-1e632a149273 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.398689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 504/1008] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:27.404635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.405039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.405202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.423035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:27.424208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:27.491552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 505/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:27.514870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100faeaa-3f37-46a5-a88a-1e632a149273 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:27.556488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:27.619003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100faeaa-3f37-46a5-a88a-1e632a149273 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:27.653448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:27.654449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.654940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.655408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.656734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:27.658465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01add93c-7fa0-4caf-8fa1-2fb282779d61 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:27.660611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 505/1010] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:27.666962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:27.763587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:27.767621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ec41-c6dc-4e88-894e-5048c46ac8ca None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:27.801155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:27.801802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.802086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.802352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.803030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:27.804646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01451-5faf-4db9-891c-29e31cc80c09 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:27.836154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 506/1011] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:27 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:27.890924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284936c-930d-49d4-8856-37bc1b28f191 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.891208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284936c-930d-49d4-8856-37bc1b28f191 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.891492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284936c-930d-49d4-8856-37bc1b28f191 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.893092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 506/1012] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:27.898627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:27.898921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:27.899199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:27.918865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:27.920095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:27.999173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 507/1013] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:28.021503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284936c-930d-49d4-8856-37bc1b28f191 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:28.127900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284936c-930d-49d4-8856-37bc1b28f191 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:28.135169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:28.164282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:28.164929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.165293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.165599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.166798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:28.168265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e913ebcb-e179-4b14-974e-5f649d2670fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:28.177451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:28.178488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 11:34:28.179371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:28.184301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 507/1014] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:28.185730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:28.268057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:28.277348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9a29-33e6-4ae0-8dd0-24eb66ca62b3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.277587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9a29-33e6-4ae0-8dd0-24eb66ca62b3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.277863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9a29-33e6-4ae0-8dd0-24eb66ca62b3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.279351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 508/1015] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:28.284141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8906-90f8-4252-8561-58267914a58f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.284443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8906-90f8-4252-8561-58267914a58f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.284712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8906-90f8-4252-8561-58267914a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.289334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543cbe-b500-4178-adb6-3764aab70c61 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:28.302944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c85b8906-90f8-4252-8561-58267914a58f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:28.304342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c85b8906-90f8-4252-8561-58267914a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:28.326551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:28.327175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.327452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.327725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.328404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:28.328708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:28.330126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:28.335752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 508/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:28.341672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:28.379333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 509/1017] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:28.402450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8906-90f8-4252-8561-58267914a58f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:28.449566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058803db-c9d5-4da2-b288-c4d0e0784503 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:28.485586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:28.486207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.486487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.486757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.487429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] RBAC: Adding query filter params (type=compute) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:28.488141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:28.489549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:28.500284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 509/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Jul 29 11:34:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:28.501384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:28.515008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:28.516135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:28.519387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8906-90f8-4252-8561-58267914a58f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:28.557941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881934-237e-4a11-8806-d342a382e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:28.558442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881934-237e-4a11-8806-d342a382e65b None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.559058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881934-237e-4a11-8806-d342a382e65b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.559058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881934-237e-4a11-8806-d342a382e65b None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.559684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69881934-237e-4a11-8806-d342a382e65b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:28.561008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69881934-237e-4a11-8806-d342a382e65b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:28.577904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 510/1019] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:28 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:34:28.616772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1407dd1-4288-4fbe-9925-27d7cab7af8e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:28.663194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:28.663877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:28.664157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:28.664426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:28.665187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:28.667209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154dac6-4999-4af3-a9f3-3e0656babcee None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:28.697466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 510/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:29.915734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48c7b-5ca1-48db-92f7-49b423a00a4a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:29.916345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48c7b-5ca1-48db-92f7-49b423a00a4a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:29.916633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48c7b-5ca1-48db-92f7-49b423a00a4a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:29.918081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 511/1021] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:29.923489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:29.923875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:29.924052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:29.942314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:29.943503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:30.000494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:30.019652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 511/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:30.043772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48c7b-5ca1-48db-92f7-49b423a00a4a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:30.146620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48c7b-5ca1-48db-92f7-49b423a00a4a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:30.191004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:30.191526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.191808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.192102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.193284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:30.194756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d26de-b9c3-4d69-a429-aac5c3b96604 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:30.201246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 512/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:30.202294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:30.310640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a6e62-e435-42c3-9d67-919a8eb866dc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:30.344694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:30.345322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.345625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.345904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.346586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:30.348024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d575de-a777-4c24-8fe2-c3507376708b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:30.372306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 512/1024] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:34:30 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:30.609623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c058ea-d736-4d2e-80df-5ba34ab46ab4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.609976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c058ea-d736-4d2e-80df-5ba34ab46ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.610094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c058ea-d736-4d2e-80df-5ba34ab46ab4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.611588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 513/1025] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:30.616532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f128-1ede-4200-8fc5-0914a9ddcaa7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.616823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f128-1ede-4200-8fc5-0914a9ddcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.617094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f128-1ede-4200-8fc5-0914a9ddcaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.636183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2a78f128-1ede-4200-8fc5-0914a9ddcaa7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:30.637358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2a78f128-1ede-4200-8fc5-0914a9ddcaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:30.676992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:30.706703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 513/1026] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:30.728407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c058ea-d736-4d2e-80df-5ba34ab46ab4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:30.758836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:30.825396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3c85-d3e8-4884-a0d8-98c7ee5e37e9 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.825739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3c85-d3e8-4884-a0d8-98c7ee5e37e9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.826006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3c85-d3e8-4884-a0d8-98c7ee5e37e9 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.827516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 514/1027] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:30.832436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.832726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.832993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.838484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c058ea-d736-4d2e-80df-5ba34ab46ab4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:30.852699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:30.854096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:30.878918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:30.879483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:30.879770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:30.880044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:30.880766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:30.882282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:30.894334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:30.895350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:30.897090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 514/1028] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Jul 29 11:34:30 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:30.901650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:30.931737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:30.954686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.005052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.017825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993775-7cfc-4c99-8b6a-24d4fd554bb2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.054716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.055609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.055891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.056160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.057613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] RBAC: Adding query filter params (name=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.058224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.059863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.060613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb43f-8c99-40c2-924a-6e06adb9a123 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.062967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.070661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 515/1030] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:31.071896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.098568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.099458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.099741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.100026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.111584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:31.116625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:31.117679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:31.118557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:31.123677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 516/1031] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:31.124339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.187756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b0d92-d838-40c7-a0e6-cc9aa488b72f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.231872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.232766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.233196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.233659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.234490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.234939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.236564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.240971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7beb-94f8-4797-9c54-b15a44f37515 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.246962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 516/1032] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:31.247799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.271080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.278039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.278906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.279379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.279652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.280368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.280671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.282085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.290196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 517/1033] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:31.295890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.324305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.360439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1eaf-cafe-4c39-be5d-5771328b3ec1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.395226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.395843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.396121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.396393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.397135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] RBAC: Adding query filter params (interface=public, service_id=817d23a35cd24f85ba68be8e35daeaf7, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.397473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.398841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.401957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c064-92be-4b5d-8c34-0a91bee4408e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.403915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 517/1034] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/endpoints?service_id=817d23a35cd24f85ba68be8e35daeaf7&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:31.409329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.442555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.443119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.443399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.443672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.456238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.457715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:31.474764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:31.475671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:31.476572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:31.476572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:31.476572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:31.476572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:31.478765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 518/1035] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:31.484534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.500847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.520795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4029-02c1-4d8e-91b9-ff72f2312a4e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.559037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.559664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.559942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.560213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.560866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.562481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.566465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:31.571545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 518/1036] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:34:31.593572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b19e-e819-4f2d-b265-7a7bb10353c1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.631437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.632072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.632355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.632629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.633337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.633680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.635651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.653768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:31.655729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.767965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db0ad1-151e-44d3-96c7-90eee7fa0436 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.803674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.804627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.805101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.805606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.813588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.815217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:31.827136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:31.828111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:31.829097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:31.830748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 519/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:31.836637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:31.942028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d6c4b-6771-4c5d-8009-b00ab1658340 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:31.977318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:31.978308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:31.979378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:31.979806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:31.980762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:31.981287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:31.982884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:31.991273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.002694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:34:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:32.008504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.021438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.119722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df716a6-d6a2-48ea-a09b-b57f66a721b6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.154631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.155495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.155927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.156350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.235210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:32.236653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d120a-0468-4ad1-b878-cd94ac61289e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:32.246830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.342665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:32.344075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.445929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76afa34-1a7e-4a68-9498-0e0bc9445ea9 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.450427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb429-777e-4c0d-95cd-a12cc1278736 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.450718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb429-777e-4c0d-95cd-a12cc1278736 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.451000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb429-777e-4c0d-95cd-a12cc1278736 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.453456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 521/1041] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:32.457201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.457515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.457801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.476420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:32.477631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:32.488420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.489731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.490452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.490914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.504213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:32.506837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:32.526232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:32.527243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:32.528145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:32.528145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:32.528145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:32.528145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:32.529990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 521/1042] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:32.535251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.551819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 522/1043] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:32.575130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.588926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.622255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.642091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a311b-46a7-4619-bc6b-f8290b911cee None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.678657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.679287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.679566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.679842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.680540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:32.680845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:32.682314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:32.695440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 522/1044] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:32.696435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a008d8a-043c-4538-be15-7dfbfef5ea98 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.701649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.743074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.744084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.745008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.745469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.760251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:32.765607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:32.766535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:32.767430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 523/1045] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:32.772832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.818445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf90d-434b-4352-9367-1b7ce9573f4a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.831025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.862899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.863582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.863866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.864139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.872376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:32.873795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:32.885772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:32.886718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:32.887631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:32.892278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 523/1046] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:32.893118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:32.907178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:32.912422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66648cb-4dc2-4516-88e2-73a3b97340c2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:32.964837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:32.966401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:32.966901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:32.967615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:32.968552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:32.969250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:32.971533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:32.983831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 524/1047] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:32.990218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.018216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8d2-60e8-415c-a362-fda9a2a8c69b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.064582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.065219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.065525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.065804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.066563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:33.066869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.068321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.084388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 524/1048] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:33.090823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.111499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c65dec-3808-42fd-a708-e0ea832c3bf3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.121847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:33.153120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.154019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.154302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.154574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] PATH_INFO: `/v3/users/872b92c9927e450ab1f9ed3077a4d498` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.175551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] RBAC: Authorizing `identity:get_user(user_id=872b92c9927e450ab1f9ed3077a4d498)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.177062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.180824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 525/1049] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:32 2022] GET /identity/v3/users/872b92c9927e450ab1f9ed3077a4d498 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:33.187971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.216099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:33.229304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e240-867c-40a5-8a03-c1c5cab5115b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.266201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.266848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.267128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.267407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.268188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] RBAC: Adding query filter params (role.id=38656cf884084e6db7d1c919c3f55d05, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:33.268497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.269950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.285451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 525/1050] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=38656cf884084e6db7d1c919c3f55d05 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:33.319950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3e956-467d-4fe6-9be9-edac3b698213 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.359261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.359901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.360183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.360457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.436327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.437820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddced06-8ebc-4ca9-8767-a955b26971b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.456587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:33.542303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 526/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:33.548448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.621334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12933b7-3374-4aab-bdb2-6c8a7eeac9e4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.621651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12933b7-3374-4aab-bdb2-6c8a7eeac9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.621932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12933b7-3374-4aab-bdb2-6c8a7eeac9e4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.623431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 527/1052] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:33.628219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.628510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.628793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.646033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:33.647530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:33.648733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:33.657734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1891-7841-4da6-b501-a8c986fa3bb5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.692485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.693032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.693312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.693618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.694766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.696202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.703440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 526/1053] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:33.704673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.721492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 528/1054] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:33.742728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.793617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:33.818482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04ab30-1804-4840-8f86-bcdcf3b18291 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.848819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11efc9-3c83-40e3-960d-c72c6390c1ae None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:33.855305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.855922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.856643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.856923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.857746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=d801f9845ec3418cad15948dc181457e, user.id=872b92c9927e450ab1f9ed3077a4d498) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:33.858413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.860190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.865797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 527/1055] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/role_assignments?user.id=872b92c9927e450ab1f9ed3077a4d498&scope.project.id=d801f9845ec3418cad15948dc181457e&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:33.895188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:33.895884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:33.896156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:33.896431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] PATH_INFO: `/v3/services/image` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:33.897073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:33.898506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:33.908716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:33.910017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 11:34:33.910859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:33.913794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 529/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:33.916992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:33.946520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:34.032747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f7011-e908-4f96-a070-c823d7e55ee4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:34.067323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:34.068028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:34.068313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:34.068610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:34.069286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] RBAC: Adding query filter params (name=image) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:34.069617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:34.070989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:34.080615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 528/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:34.081805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:34.193231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d075f-29c0-4cfc-8977-de535d2cec51 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:34.206514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:34.229953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:34.230576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:34.230858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:34.231139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:34.231812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] RBAC: Adding query filter params (type=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:34.232117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:34.233502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c478d76-9dce-4567-be33-a2c17a694d09 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:34.238477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 530/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:34.244849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:34.335528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:34.349525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5051-4929-4dbf-a621-d14f82ea797c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:34.382909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:34.383561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:34.383845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:34.384122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:34.384921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:34.386387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae398-96bb-4252-94db-4549f9292474 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:34.408517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 529/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:34:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:35.287129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1887c-cc3f-43c9-bd70-866e57ca7abd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.287637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1887c-cc3f-43c9-bd70-866e57ca7abd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.287743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1887c-cc3f-43c9-bd70-866e57ca7abd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.289147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 531/1060] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:35.294252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.294649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.294837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.313339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:35.314535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:35.387214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 530/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:35.408872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1887c-cc3f-43c9-bd70-866e57ca7abd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:35.511953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1887c-cc3f-43c9-bd70-866e57ca7abd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:35.547774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:35.548419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.548695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.548963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.560100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:35.564988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:35.566993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:35.569497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 532/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:35.572947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:35.643983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:35.676919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed404c-3915-4fd4-9f31-d0f7a4f09dd4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:35.711985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:35.712605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.713506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.713732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.714439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:35.714742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:35.716129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6359b-2729-44ef-aee9-f4f4b78afcb6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:35.728808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 531/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:35.730515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:35.768686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:35.837378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292747-ccbb-448a-8488-64e4b178bdf5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:35.872436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:35.873086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.873370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.873678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.878308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff848d-8a6d-4235-9892-5c2b7eabf4ab None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.878597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff848d-8a6d-4235-9892-5c2b7eabf4ab None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.878875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff848d-8a6d-4235-9892-5c2b7eabf4ab None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.880338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 532/1064] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:35.885801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:35.886083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:35.886358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:35.886461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:35.887886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:35.903206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:35.904177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:35.905150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:35.905150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:35.905150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:35.905150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:35.905150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 533/1065] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:35.906484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:35.907675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:35.909882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:35.978262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 533/1066] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:36.001222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.008292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.023645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562fd46-b433-4b58-990c-a38db95cec29 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.060432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.061057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.061336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.061637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.062333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:36.062634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.063990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.071543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.081720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 534/1067] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:36.082816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.112095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298977f-205b-4c87-93bf-25753cacced6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.148681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.149735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.150216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.150706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.164018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:36.170486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:36.171383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:36.173008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 534/1068] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:36.180381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.199879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0d2f-5d89-4b1c-9ac7-7fe488db9f6f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.238093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.238837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.239016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.239288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.247471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.248949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:36.262138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:36.263119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:36.264337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 535/1069] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:36.269388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.280794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.288394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cfada-2744-465a-b564-02d106ddc39c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.312456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.324945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.325592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.325879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.326157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.326872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:36.327174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.328541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.336656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 535/1070] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:36.342463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.385205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98d0a6-6615-4a9b-a301-406afdc6dc95 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.420841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.421477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.421869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.422135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.422914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:36.423215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.424726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebbbcd-6562-4518-b20b-eeaa049cfb7d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.448112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 536/1071] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:36.448331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd608468-b0f6-4ea0-89f2-7755beb16422 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.448432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5e14-1d65-4550-b740-8b20b6ed7d25 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.448432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5e14-1d65-4550-b740-8b20b6ed7d25 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.448432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5e14-1d65-4550-b740-8b20b6ed7d25 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.448432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 537/1072] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:36.448960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5e14-1d65-4550-b740-8b20b6ed7d25 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.481819 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.482457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.482737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.483006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] PATH_INFO: `/v3/users/872b92c9927e450ab1f9ed3077a4d498` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.484192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] RBAC: Authorizing `identity:get_user(user_id=872b92c9927e450ab1f9ed3077a4d498)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.485658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb8674-12d6-49be-8246-82559d57b06b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.487394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 536/1073] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/users/872b92c9927e450ab1f9ed3077a4d498 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:36.488373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.488660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.488934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.506679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:36.507864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:36.517487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.553589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5e14-1d65-4550-b740-8b20b6ed7d25 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.554990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.575268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 537/1074] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:36.576076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.595489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.596157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.596581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.596856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.608806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.610287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:36.624857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:36.625843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:36.626743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:36.626743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:36.626743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:36.626743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:36.626743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 538/1075] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:36.627038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.681774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724752f-3b14-490b-875a-c2b5c86b770f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.716652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.717285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.717605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.717876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.719038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.720461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.722127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 538/1076] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:36.722868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.733393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689f55f-ad34-4b58-908e-f8dd63a6c865 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.750936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.768894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.769542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.769830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.770109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.771699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.821132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382815a-7953-4a5b-9e87-c3dd033f13e3 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.838241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.839695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.856703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:36.857495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:36.857869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:36.858240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:36.859039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:36.859439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:36.860928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:36.872578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 539/1077] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:36.873495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.938197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 539/1078] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:36.939123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:36.957522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:36.975009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b72c-7c90-4f6a-bab8-c2fccd83f33f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:36.985723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:37.009770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.010643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.010928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.011204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e/users/872b92c9927e450ab1f9ed3077a4d498/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.013165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=d801f9845ec3418cad15948dc181457e, user_id=872b92c9927e450ab1f9ed3077a4d498, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.014908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.027955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 540/1079] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:36 2022] PUT /identity/v3/projects/d801f9845ec3418cad15948dc181457e/users/872b92c9927e450ab1f9ed3077a4d498/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:34:37.028751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:37.049110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c50d39-b937-4bb5-b67c-dc8984194123 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:37.090963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.091950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.092412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.092864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.100682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.102352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:37.115392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:37.116397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:37.117284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 540/1080] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:37.125029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:37.157409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a418c-1425-4511-b838-f26b06765e2c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:37.201090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.201775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.202057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.202334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.214975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.216439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.224626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:37.232583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:37.233512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:37.234446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:37.234446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:37.234446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:37.234446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:37.234446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 541/1081] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:37.239899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:37.248098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f31d-3127-451b-bfa9-71bb2b9914eb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:37.266550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:37.288976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.289625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.289911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.290184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.290980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:37.291307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.292731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.310620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 541/1082] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:37.311659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:37.354704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d647f-f459-4309-855d-e2d74f1caa02 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:37.390577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.391200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.391482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.391758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.392449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:37.392878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.394305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45f03-8b15-4b9a-95c6-147a9c6d1eb9 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.409770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 542/1083] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:37.420080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde1d3-1fdd-4456-8951-f434c80534be None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:37.459357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:37.460059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:37.460338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:37.460611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/38656cf884084e6db7d1c919c3f55d05` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:37.463610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=a2502e6309ca4a688de48416b09d16c3, role_id=38656cf884084e6db7d1c919c3f55d05)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:37.465092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864470-bdf2-46ad-845a-cc9c7121d08e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:37.474589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:37.485510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 542/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:37 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/a2502e6309ca4a688de48416b09d16c3/roles/38656cf884084e6db7d1c919c3f55d05 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:34:39.034203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d61c-e35b-4436-b840-73bbac6d5981 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.034736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d61c-e35b-4436-b840-73bbac6d5981 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.034736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d61c-e35b-4436-b840-73bbac6d5981 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.036069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 543/1085] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:39.041924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.042348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.042583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.060631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:39.061842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:39.127336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 543/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:39.151715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d61c-e35b-4436-b840-73bbac6d5981 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.237847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:39.257523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d61c-e35b-4436-b840-73bbac6d5981 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.292376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.292942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.293223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.293528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.303350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:39.308243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:39.309407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:39.310541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 544/1087] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:39.315341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.413858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f7d4-615d-42d0-9325-3c2d2be7869b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.439471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:39.448350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.448975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.449258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.449573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.450286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:39.450596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:39.451954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23ed1-f4cc-47f8-91b6-62130cf1823c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:39.460045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 544/1088] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:39.466115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.484417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ecc0-edbc-4d3d-839b-dd81d1037062 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.484700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ecc0-edbc-4d3d-839b-dd81d1037062 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.484976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ecc0-edbc-4d3d-839b-dd81d1037062 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.486344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 545/1089] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:34:39.491001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.491293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.491568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.509447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:39.510849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:39.566340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7309e-2595-46dd-9ad0-d67ced9104cf None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.578419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 546/1090] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:39.599046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.599682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.599957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.600224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] PATH_INFO: `/v3/users/872b92c9927e450ab1f9ed3077a4d498` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.601371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] RBAC: Authorizing `identity:get_user(user_id=872b92c9927e450ab1f9ed3077a4d498)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:39.601978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.602808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:39.605190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 545/1091] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/users/872b92c9927e450ab1f9ed3077a4d498 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:39.611157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.623329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:39.702053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2f67-4949-4bb0-b784-b29886c39ab9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.713890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da685-02b9-4cb5-96d0-28500d769576 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.722452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:39.737118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.737790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.738071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.738342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.748538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:39.748772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.749390 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.749698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.749971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:39.753516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:39.754462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:39.755297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 547/1092] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:34:39.760716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.816851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:39.818252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:39.829203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:39.860754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2ea01-5049-4623-b2e8-d8e660ebb1b1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:39.894867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:39.895476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:39.895753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:39.896027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:39.896720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:39.897021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:39.898406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:39.910858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 548/1093] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:39.911809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.916557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 546/1094] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 11:34:39.922373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:39.954356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.011427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44393-282d-4f52-a65d-469bd9a28f5a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.021465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450cea7-3a0a-41e3-874d-56851bfc6564 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.032264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.045890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.046540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.046823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.047101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.055712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.056344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.057244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.057538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.058684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.058819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.060107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.060270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.061771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 547/1095] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:40.067737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:40.074979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:40.075901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 549/1096] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:40.081799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.168550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87094c1-276c-4ff5-81a5-9b76b3aac414 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.174545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.185545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e15f8-307c-466d-b1f2-af0f7a58d107 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.204999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.205644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.205924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.206196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.206971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=d801f9845ec3418cad15948dc181457e, user.id=872b92c9927e450ab1f9ed3077a4d498) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:40.207278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.208694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.214892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 548/1097] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/role_assignments?user.id=872b92c9927e450ab1f9ed3077a4d498&scope.project.id=d801f9845ec3418cad15948dc181457e&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:40.220947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.221622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.221909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.222186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.222895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:40.223204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.224611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.238387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 550/1098] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:40.244270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.292214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.353050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b956-fdd1-479b-991f-d3d1a830717e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.388716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.389686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.389968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.390239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.397874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.399310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:34:40.411426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:40.412394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:40.413459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 549/1099] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:40.418465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.516501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bbcf-e7cd-4863-a3c0-5c07154d8dc3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.548944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.549586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.549862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.550129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.550918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:40.551221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.552632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.570364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 551/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:40.576731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.673270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc461ca-0ed4-44c6-b22c-935d3c00298e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:40.674742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.707658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:40.708280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:40.708558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:40.708833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:40.776496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:40.777981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:40.874043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 550/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:40.879779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:40.896761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:40.983806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eae04-1c8b-498d-a153-f562f371dd15 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:41.017945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:41.018651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:41.018933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:41.019209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:41.029589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:41.031049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:34:41.045306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:41.046635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:41.047542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:34:41.047542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:34:41.047542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:34:41.047542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:41.047542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 552/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:41.052097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:41.054262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:41.148954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3658-70c3-4176-8e58-4adbfd2478c5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:41.183277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:41.183890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:41.184176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:41.184451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:41.185137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:41.185506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:41.186898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:41.199775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 551/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:41.205386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:41.266493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:41.304586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475ed4-5526-4682-aa81-70387b6f09da None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:41.337232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:41.338451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:41.338732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:41.339010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:41.346697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:41.348171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:34:41.360987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:41.362201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:34:41.363113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 553/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:41.368062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:41.433389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:41.472117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5b0c-fe22-4149-b01d-4100c045a194 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:41.504181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:41.504793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:41.505069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:41.505336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:41.506098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:41.506400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:41.507821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8324c-bd01-4418-abf5-b9395e4f8969 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:41.520251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 552/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:41.526808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:41.622493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de44157-d0d3-425d-8872-d524f0429495 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:41.645149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:41.656363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:41.656975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:41.657250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:41.657548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:41.658325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] RBAC: Adding query filter params (role.id=38656cf884084e6db7d1c919c3f55d05, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=a2502e6309ca4a688de48416b09d16c3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:41.658630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:41.660037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153370c9-7f6e-4a82-bf15-ec8799b6a75b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:41.666436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 554/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:41 2022] GET /identity/v3/role_assignments?user.id=a2502e6309ca4a688de48416b09d16c3&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=38656cf884084e6db7d1c919c3f55d05 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:42.251117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457be6-3394-48f9-815a-0441caaf2f97 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:42.251650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457be6-3394-48f9-815a-0441caaf2f97 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:42.251650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457be6-3394-48f9-815a-0441caaf2f97 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:42.252996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 553/1107] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:42.258437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:42.258885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:42.258983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:42.279178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:42.280349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:42.349912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 555/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:42.374583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457be6-3394-48f9-815a-0441caaf2f97 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:42.479061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457be6-3394-48f9-815a-0441caaf2f97 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:42.501941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:42.514588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:42.515230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:42.515511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:42.515786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:42.516926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:42.518393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e12e0-4607-4fb0-a872-a1553bf08c9a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:42.519974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 554/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:34:42.526470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:42.621476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc743f-92cf-49bc-8ba6-5c7de436691d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:42.638528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:42.655493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:42.656106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:42.656387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:42.656662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:42.657344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:42.658790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604845a9-3962-4e6a-9839-2793427f2e88 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:42.678552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 556/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:34:42 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:44.709844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4acec-6472-4415-a6f5-7d53721c1938 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:44.710354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4acec-6472-4415-a6f5-7d53721c1938 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:44.710443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4acec-6472-4415-a6f5-7d53721c1938 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:44.711726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 555/1111] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:44.717015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:44.717448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:44.717588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:44.735651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:44.736813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:44.802876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 557/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 11:34:44.825341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4acec-6472-4415-a6f5-7d53721c1938 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:44.925872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4acec-6472-4415-a6f5-7d53721c1938 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:44.957892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:44.958528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:44.958809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:44.959084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] PATH_INFO: `/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:44.960558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] RBAC: Authorizing `identity:get_role(role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:44.961912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:44.964152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 556/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:44 2022] GET /identity/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:44.969940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:45.066295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d10bc-65bb-4a2b-a098-1f5935a2f770 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:45.068561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:45.100243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:45.100877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:45.101160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:45.101463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] PATH_INFO: `/v3/users/9465cf30a33d49c0aef5dd17b3335845` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:45.114959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] RBAC: Authorizing `identity:get_user(user_id=9465cf30a33d49c0aef5dd17b3335845)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:45.116383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:45.118031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 558/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:44 2022] GET /identity/v3/users/9465cf30a33d49c0aef5dd17b3335845 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:45.123969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:45.181311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:45.223817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ef41-c722-4ef9-a6b0-fb8fe34863da None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:45.256480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:45.257092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:45.257393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:45.257679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:45.322927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:45.324360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:45.377746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:45.419072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 557/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:45.424930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:45.519870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783f7f-fbef-48af-971c-28f9979d16c1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:45.552534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:45.553156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:45.553451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:45.553725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:45.554842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:45.556239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683c9e6-0435-4659-9f47-dc1ec596e06e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:45.558676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 559/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:45 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:45.564679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:45.662022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631db0f4-0d6d-423d-a8b9-961ea32d9bd5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:45.694494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:45.695098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:45.695372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:45.695640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:45.696410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=d801f9845ec3418cad15948dc181457e, user.id=9465cf30a33d49c0aef5dd17b3335845) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:45.696715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:45.698933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5c09-df29-4434-8f2d-bd4efe32cdf4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:45.704102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 558/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:45 2022] GET /identity/v3/role_assignments?user.id=9465cf30a33d49c0aef5dd17b3335845&scope.project.id=d801f9845ec3418cad15948dc181457e&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:47.658997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33935cc-5e61-46e3-80fd-b3b4a70bead6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:47.659546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33935cc-5e61-46e3-80fd-b3b4a70bead6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:47.659546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33935cc-5e61-46e3-80fd-b3b4a70bead6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:47.660845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 560/1118] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:47.666595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:47.666988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:47.667137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:47.685233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:47.686441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:47.702261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:47.750861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 559/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:47.772883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33935cc-5e61-46e3-80fd-b3b4a70bead6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:47.803280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:47.872611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33935cc-5e61-46e3-80fd-b3b4a70bead6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:47.906015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:47.906652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:47.906932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:47.907207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] PATH_INFO: `/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:47.908619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] RBAC: Authorizing `identity:get_role(role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:47.910058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:47.911350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 561/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:47 2022] GET /identity/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:47.917864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:48.018714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d460b-50a9-4480-893a-c17f34cd9752 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:48.052000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:48.052640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:48.052924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:48.053197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] PATH_INFO: `/v3/users/9465cf30a33d49c0aef5dd17b3335845` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:48.054374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] RBAC: Authorizing `identity:get_user(user_id=9465cf30a33d49c0aef5dd17b3335845)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:48.055799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:48.057400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 560/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:47 2022] GET /identity/v3/users/9465cf30a33d49c0aef5dd17b3335845 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:48.063193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:48.160048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:48.164216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d39c-e837-44cd-9bf5-39a5a97f3315 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:48.198586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:48.199225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:48.199505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:48.199777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:48.200912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:48.202362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa86be-58e3-41bf-b466-498a5aaaff87 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:48.204021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 562/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:48 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:48.209942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:48.231699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:48.307533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0c544-0577-480b-aab5-ea7362bf490d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:48.341319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:48.342000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:48.342277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:48.342548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e/users/9465cf30a33d49c0aef5dd17b3335845/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:48.344675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] RBAC: Authorizing `identity:create_grant(project_id=d801f9845ec3418cad15948dc181457e, user_id=9465cf30a33d49c0aef5dd17b3335845, role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:48.346137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be1e6-8ec0-4fb8-9a03-eb30cd6cf057 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:48.358744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 561/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:34:48 2022] PUT /identity/v3/projects/d801f9845ec3418cad15948dc181457e/users/9465cf30a33d49c0aef5dd17b3335845/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:34:50.320163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801470-3598-42c1-b39d-ce0dcb6b31aa None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:50.320709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801470-3598-42c1-b39d-ce0dcb6b31aa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:50.320709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801470-3598-42c1-b39d-ce0dcb6b31aa None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:50.322765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 563/1124] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:50.327974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:50.328392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:50.328506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:50.346629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:50.347790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:50.413976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 562/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:50.437321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801470-3598-42c1-b39d-ce0dcb6b31aa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:50.537267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801470-3598-42c1-b39d-ce0dcb6b31aa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:50.569925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:50.570553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:50.570833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:50.571108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] PATH_INFO: `/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:50.573183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] RBAC: Authorizing `identity:get_role(role_id=7e22b2c7d9c341d0a2a01fb9be2d7f42)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:50.574590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:50.575924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 564/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:50 2022] GET /identity/v3/roles/7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:50.581710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:50.593893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:50.680603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2772-1b64-461f-b8f2-550ae3110218 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:50.714092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:50.714734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:50.715017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:50.715292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] PATH_INFO: `/v3/users/9465cf30a33d49c0aef5dd17b3335845` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:50.716448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] RBAC: Authorizing `identity:get_user(user_id=9465cf30a33d49c0aef5dd17b3335845)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:50.717912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:50.719499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 563/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:50 2022] GET /identity/v3/users/9465cf30a33d49c0aef5dd17b3335845 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:50.725261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:50.759185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:50.824874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b788ff-1195-47a5-85f5-4da48d98f66e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:50.858872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:50.859482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:50.859763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:50.860040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:50.926095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:50.927515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:50.959292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:51.024726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 565/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:51.030966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:51.107159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:51.128426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19608faf-bde9-4e0c-8af7-3819aa6528e5 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:51.161540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:51.162168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:51.162452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:51.162729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] PATH_INFO: `/v3/projects/d801f9845ec3418cad15948dc181457e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:51.163863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] RBAC: Authorizing `identity:get_project(project_id=d801f9845ec3418cad15948dc181457e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:51.165295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44a0a3-68d8-4fd8-9152-c1dd71772f0d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:51.167470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 564/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:51 2022] GET /identity/v3/projects/d801f9845ec3418cad15948dc181457e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:51.173667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:51.270203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f9cd-329b-4001-ae91-c3794f62f9f1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:51.302538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:51.303143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:51.303420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:51.303690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:51.304459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] RBAC: Adding query filter params (role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42, scope.project.id=d801f9845ec3418cad15948dc181457e, user.id=9465cf30a33d49c0aef5dd17b3335845) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:51.304766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:51.306202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edcc6a-e085-456b-95bf-5c8905bf8582 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:51.308546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:51.313625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 566/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:51 2022] GET /identity/v3/role_assignments?user.id=9465cf30a33d49c0aef5dd17b3335845&scope.project.id=d801f9845ec3418cad15948dc181457e&role.id=7e22b2c7d9c341d0a2a01fb9be2d7f42 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:53.314471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e08cad-64e8-4277-ab68-05ebf552612c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:53.315014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e08cad-64e8-4277-ab68-05ebf552612c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:53.315014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e08cad-64e8-4277-ab68-05ebf552612c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:53.316347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 565/1131] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:53.321390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:53.321824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:53.322767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:53.340782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:53.341977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:53.407317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 567/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:53.430073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e08cad-64e8-4277-ab68-05ebf552612c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:53.528888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e08cad-64e8-4277-ab68-05ebf552612c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:53.561906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:53.562530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:53.562807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:53.563080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:53.564207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:53.565654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f2a2-d47f-4e79-944f-be0679258de1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:53.567195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 566/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:53.573179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:53.669310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78191-6aef-4314-82a9-a3deecb55362 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:53.694823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:53.702893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:53.703503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:53.703782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:53.704062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:53.704728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:53.706168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42fbee-6867-45eb-89c3-f25bdd017b77 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:53.732342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 568/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:34:53 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:55.732806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71115-4bd2-43c8-918a-da085a8cb708 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:55.733331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71115-4bd2-43c8-918a-da085a8cb708 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:55.733331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71115-4bd2-43c8-918a-da085a8cb708 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:55.734728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 567/1135] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:55.739927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:55.740364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:55.740466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:55.758271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:55.760026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:55.825234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 569/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:55.849877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71115-4bd2-43c8-918a-da085a8cb708 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:55.865143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:55.949439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71115-4bd2-43c8-918a-da085a8cb708 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:55.982132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:55.982754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:55.983080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:55.983298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:55.984415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:55.985861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a7df9-0378-428a-a5f9-6186719da3a8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:55.987411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 568/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:55.993289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:56.089798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f338b-3ba5-4f07-ab74-b1b80a4e3464 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:56.100072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:56.123967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:56.124580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:56.124864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:56.125142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:56.125856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:56.127281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e580b2-5a74-42cd-af59-462b1c2d6e72 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:56.147951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 570/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:34:55 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:34:58.179565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a25fa-e4be-4a3b-95de-b8c33cd98423 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.180104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a25fa-e4be-4a3b-95de-b8c33cd98423 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.180104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a25fa-e4be-4a3b-95de-b8c33cd98423 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.182190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 569/1139] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:34:58.187418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.187803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.187959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.205949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:34:58.207127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:34:58.272236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 571/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:34:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:34:58.297054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a25fa-e4be-4a3b-95de-b8c33cd98423 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:58.378414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:58.399129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a25fa-e4be-4a3b-95de-b8c33cd98423 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:58.442284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:58.443152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.443584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.444005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.460609 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:34:58.468997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:34:58.470256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:34:58.471345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 570/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:34:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:34:58.477215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:58.570306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:58.577138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9247e4-5663-4e55-b7f6-e4d2ed8c56f1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:58.609809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:58.610416 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.610691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.610958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.611656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:58.611957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:58.613309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:58.621563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 572/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:58.627333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:58.725407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2c32-e59b-494d-8ff2-f0e38989d34b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:58.758580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:58.759237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.759530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.759803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] PATH_INFO: `/v3/users/65d847fc9c1a4211bce9d11df8639f1e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.770927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:58.773323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] RBAC: Authorizing `identity:get_user(user_id=65d847fc9c1a4211bce9d11df8639f1e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:58.775115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:58.777174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 571/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:34:58 2022] GET /identity/v3/users/65d847fc9c1a4211bce9d11df8639f1e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:58.782980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:58.883899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3b0b-9306-4a2e-9919-be5d1964fe34 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:58.917117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:58.917756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:58.918035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:58.918307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:58.944670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:58.984578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:58.986005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:59.083209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 573/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:34:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:34:59.089706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:59.187196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2db54a-ad53-41fc-bc04-89200126ebda None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:59.220693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:59.221323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:59.221631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:59.221907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] PATH_INFO: `/v3/projects/f35720229b954ababe521f11e1b12126` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:59.223054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] RBAC: Authorizing `identity:get_project(project_id=f35720229b954ababe521f11e1b12126)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:59.224482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e89ec1-78a7-4907-ba54-0eda10a5e235 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:59.226158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 572/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:34:59 2022] GET /identity/v3/projects/f35720229b954ababe521f11e1b12126 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:34:59.232496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:34:59.289061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:34:59.329611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edfa58-fc54-4a95-8fc2-505174e0af68 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:34:59.362110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:34:59.362726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:34:59.363007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:34:59.363279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:34:59.364062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=f35720229b954ababe521f11e1b12126, user.id=65d847fc9c1a4211bce9d11df8639f1e) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:34:59.364372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:34:59.365821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9304-7d98-457a-9bf2-8eaee54c5fb0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:34:59.371655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 574/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:34:59 2022] GET /identity/v3/role_assignments?user.id=65d847fc9c1a4211bce9d11df8639f1e&scope.project.id=f35720229b954ababe521f11e1b12126&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:01.350130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176a24-f60d-43e5-9627-9620ce13a39c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:01.350748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176a24-f60d-43e5-9627-9620ce13a39c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:01.350748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176a24-f60d-43e5-9627-9620ce13a39c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:01.352002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 573/1147] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:01.357035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:01.357494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:01.357601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:01.375814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:01.376987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:01.442301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 575/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:01.464284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32176a24-f60d-43e5-9627-9620ce13a39c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:01.530908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:01.564305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32176a24-f60d-43e5-9627-9620ce13a39c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:01.597746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:01.598376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:01.598658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:01.598930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:01.608767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:35:01.613665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:01.614737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:35:01.615951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 574/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:01.621318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:01.671985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:01.717776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9b012-b7b6-4369-83ae-89f27b9ec9a2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:01.751786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:01.752393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:01.752668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:01.752937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:01.753662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:01.753963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:01.755313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:01.763224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 576/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:35:01.769259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:01.866153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d2b-c95a-4c5a-9a23-93b3becacbff None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:01.892059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:01.899876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:01.900511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:01.900795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:01.901071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] PATH_INFO: `/v3/users/65d847fc9c1a4211bce9d11df8639f1e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:01.902269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] RBAC: Authorizing `identity:get_user(user_id=65d847fc9c1a4211bce9d11df8639f1e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:01.903700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:01.905312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 575/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:35:01 2022] GET /identity/v3/users/65d847fc9c1a4211bce9d11df8639f1e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:01.911280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:02.009975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8fff-e08b-4be4-b685-dc404f8cc169 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:02.023346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:02.044916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:02.045588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:02.045874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:02.046151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] PATH_INFO: `/v3/projects/f35720229b954ababe521f11e1b12126` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:02.047299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] RBAC: Authorizing `identity:get_project(project_id=f35720229b954ababe521f11e1b12126)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:02.048718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff661-a213-4931-aac9-ad656329da41 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:02.050451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 577/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:35:01 2022] GET /identity/v3/projects/f35720229b954ababe521f11e1b12126 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:02.056688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:02.153200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca181d5-d183-40aa-9d6f-a389b3c1213b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:02.186338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:02.187005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:02.187283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:02.187559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] PATH_INFO: `/v3/projects/f35720229b954ababe521f11e1b12126/users/65d847fc9c1a4211bce9d11df8639f1e/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:02.189532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] RBAC: Authorizing `identity:create_grant(project_id=f35720229b954ababe521f11e1b12126, user_id=65d847fc9c1a4211bce9d11df8639f1e, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:02.191283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e735e-159d-4acb-a7bc-6e7ee20ca080 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:02.203508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 576/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:35:02 2022] PUT /identity/v3/projects/f35720229b954ababe521f11e1b12126/users/65d847fc9c1a4211bce9d11df8639f1e/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:35:04.181777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e8f4-a149-4d6b-a9f7-04dcd59b23a8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.182298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e8f4-a149-4d6b-a9f7-04dcd59b23a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.182390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e8f4-a149-4d6b-a9f7-04dcd59b23a8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.183689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 578/1154] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:04.188940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.189379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.189587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.207770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:04.208977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:04.257234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:04.276890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 577/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:04.299986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93e8f4-a149-4d6b-a9f7-04dcd59b23a8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:04.402849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93e8f4-a149-4d6b-a9f7-04dcd59b23a8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:04.435891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:04.436511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.436871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.437641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.449077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:35:04.454020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:04.455148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:35:04.456335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 579/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:04.461631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:04.571251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32c1ab-1ba0-4a71-8b5b-58376e49c25b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:04.607616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:04.608260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.608535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.608802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.609537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:04.609844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:04.611209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:04.620850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 578/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:04.626766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:04.671977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:04.730962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2a2d-28ba-4540-b28e-cad52d68bf0c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:04.768551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:04.769193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.769502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.769781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] PATH_INFO: `/v3/users/65d847fc9c1a4211bce9d11df8639f1e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.770954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] RBAC: Authorizing `identity:get_user(user_id=65d847fc9c1a4211bce9d11df8639f1e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:04.772393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:04.774068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 580/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:35:04 2022] GET /identity/v3/users/65d847fc9c1a4211bce9d11df8639f1e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:04.780793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:04.832516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:04.886974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a538a1-b1fb-4175-825c-7a0be378b4d6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:04.921812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:04.922436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:04.922716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:04.922990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:04.993467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:04.994920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:05.048457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:05.106492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 579/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:35:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:35:05.113197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:05.215393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8163-81d4-4956-81f6-ae3b30908c32 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:05.225400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:05.249404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:05.250014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:05.250295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:05.250571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] PATH_INFO: `/v3/projects/f35720229b954ababe521f11e1b12126` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:05.251708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] RBAC: Authorizing `identity:get_project(project_id=f35720229b954ababe521f11e1b12126)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:05.253125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245bba2-afce-4c49-9562-9d1084be0371 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:05.254805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 581/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:35:05 2022] GET /identity/v3/projects/f35720229b954ababe521f11e1b12126 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:05.261542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:05.356410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08d0e-6e58-4140-bfcf-f1c3472c6316 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:05.390649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:05.391266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:05.391544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:05.391816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:05.392593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=f35720229b954ababe521f11e1b12126, user.id=65d847fc9c1a4211bce9d11df8639f1e) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:05.392900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:05.394368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8838-7470-4a15-a3f1-0a3c8cc13543 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:05.400206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 580/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:35:05 2022] GET /identity/v3/role_assignments?user.id=65d847fc9c1a4211bce9d11df8639f1e&scope.project.id=f35720229b954ababe521f11e1b12126&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:07.409005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdf79-7938-4020-a341-6319d171ab3c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:07.409609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdf79-7938-4020-a341-6319d171ab3c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:07.409609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdf79-7938-4020-a341-6319d171ab3c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:07.410935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 582/1162] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:07.416069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:07.416490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:07.416605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:07.434766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:07.435933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:07.443036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:07.501624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 581/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:07.523943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccdf79-7938-4020-a341-6319d171ab3c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:07.622933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccdf79-7938-4020-a341-6319d171ab3c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:07.656044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:07.656645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:07.656919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:07.657188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:07.700998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:07.721657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:07.723085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:07.816899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 583/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:35:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:35:07.823517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:07.918432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b579e1-565e-42de-bf4b-d6d5a56daec9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:07.951181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:07.951753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:07.952032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:07.952304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:07.958731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:07.960165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6fab12a0-7442-4675-bb62-9732f4570be3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:07.972727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:07.973958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:35:07.975008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 582/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:35:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:07.979978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:08.057492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:08.079122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d93e-99d8-47dc-91e2-4bcf67a73e93 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:08.112367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:08.112976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:08.113259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:08.113564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:08.114249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:08.114554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:08.115912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc05986-ba5e-4150-a81e-8666700082b3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:08.123694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 584/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Jul 29 11:35:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:10.089587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e00ac-1827-416a-a746-a70beaae7eb0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:10.090161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e00ac-1827-416a-a746-a70beaae7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:10.090161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e00ac-1827-416a-a746-a70beaae7eb0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:10.091473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 583/1167] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:10.096711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fac0-9499-498b-84c1-1dcc58ae697e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:10.097123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fac0-9499-498b-84c1-1dcc58ae697e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:10.097263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fac0-9499-498b-84c1-1dcc58ae697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:10.115721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1005fac0-9499-498b-84c1-1dcc58ae697e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:10.116891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1005fac0-9499-498b-84c1-1dcc58ae697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:10.182132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 585/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:10.204408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e00ac-1827-416a-a746-a70beaae7eb0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:10.207329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:10.305616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e00ac-1827-416a-a746-a70beaae7eb0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:10.338946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:10.339550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:10.339878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:10.340103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:10.340815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:10.342223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4929-68da-4e58-ae91-45fc20bd2ca1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:10.357930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 584/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Fri Jul 29 11:35:10 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:35:12.360176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031349a-5fb3-4c80-98e7-98ddfa147acf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:12.360713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031349a-5fb3-4c80-98e7-98ddfa147acf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:12.360713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031349a-5fb3-4c80-98e7-98ddfa147acf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:12.362122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 586/1170] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:12.367326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:12.367693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:12.367884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:12.386024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:12.387214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:12.443485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:12.454862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 585/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:12.478061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031349a-5fb3-4c80-98e7-98ddfa147acf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:12.547191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:12.577921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031349a-5fb3-4c80-98e7-98ddfa147acf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:12.610295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:12.610925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:12.611208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:12.611484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] PATH_INFO: `/v3/domains/25d795769a8943f08a04c8d9550b5b0e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:12.622118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=25d795769a8943f08a04c8d9550b5b0e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:12.623548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db626-970a-47c8-8f53-53e242413b69 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:12.625156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 587/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Fri Jul 29 11:35:12 2022] GET /identity/v3/domains/25d795769a8943f08a04c8d9550b5b0e => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:12.631008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:12.725899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192ef6-4f42-4043-aab7-fa9d1485417b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:12.758357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:12.759535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:12.759824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:12.760097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:12.760777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:12.762227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8f9e-0cd3-4dac-a75b-4dfec5ac1390 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:12.788239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 586/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:35:12 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:35:14.783857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118a4f-e01a-434a-9d86-99f3582df221 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:14.784380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118a4f-e01a-434a-9d86-99f3582df221 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:14.784380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118a4f-e01a-434a-9d86-99f3582df221 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:14.785763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 588/1174] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:14.790963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:14.791336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:14.791514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:14.809664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:14.810830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:14.848910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:14.876855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 587/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:14.901369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118a4f-e01a-434a-9d86-99f3582df221 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:14.998783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118a4f-e01a-434a-9d86-99f3582df221 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:15.026758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:15.031959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:15.032583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:15.032861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:15.033132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] PATH_INFO: `/v3/domains/25d795769a8943f08a04c8d9550b5b0e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:15.034334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] RBAC: Authorizing `identity:get_domain(domain_id=25d795769a8943f08a04c8d9550b5b0e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:15.035703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278f70e-a548-436a-9692-3fe6e972113a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:15.037262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 589/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Fri Jul 29 11:35:14 2022] GET /identity/v3/domains/25d795769a8943f08a04c8d9550b5b0e => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:15.043753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:15.139400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b801f3-9546-4f49-8694-2a9470b36998 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:15.172428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:15.173038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:15.173322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:15.173633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:15.174333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:15.175774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a067f63-3182-4a12-b3ba-67798e1c6087 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:15.196952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 588/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:35:15 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:35:17.224991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d472e-a0ab-4efa-8718-1f79242f9b9f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.225469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d472e-a0ab-4efa-8718-1f79242f9b9f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.225581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d472e-a0ab-4efa-8718-1f79242f9b9f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.226935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 590/1178] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:17.231983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.232403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.232571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.250998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:17.252187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:17.276033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:17.319593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 589/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:17.342782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d472e-a0ab-4efa-8718-1f79242f9b9f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:17.441026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d472e-a0ab-4efa-8718-1f79242f9b9f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:17.472508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:17.473123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.473401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.473703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.484429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:35:17.489243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:17.490382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:35:17.491426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 591/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:17.496907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:17.591891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef010-3053-4a0e-863c-95109776aa9e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:17.625723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:17.626336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.626614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.626886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.627599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:17.627902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:17.629262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:17.637145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 590/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:17.643398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:17.702425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:17.743909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea90cd-651f-4879-82a8-5ae4a9dea5d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:17.776479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:17.777019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.777299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.777598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] PATH_INFO: `/v3/users/a24c6f97f85b449d895c34ced1085900` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.790223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] RBAC: Authorizing `identity:get_user(user_id=a24c6f97f85b449d895c34ced1085900)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:17.791628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:17.793235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 592/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:35:17 2022] GET /identity/v3/users/a24c6f97f85b449d895c34ced1085900 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:17.799097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:17.824994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:17.900187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db19a-682c-486d-96cf-8104fb71632a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:17.932743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:17.933350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:17.933656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:17.933932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:17.998094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:17.999464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:18.021846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:18.094003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 591/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:35:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:35:18.099859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:18.198078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9dcc-f7a6-42fc-b025-1ed33a009425 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:18.215125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:18.232089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:18.232732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:18.233013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:18.233287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] PATH_INFO: `/v3/projects/1af2be1a5974462fb6a125415cfad7d3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:18.234475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] RBAC: Authorizing `identity:get_project(project_id=1af2be1a5974462fb6a125415cfad7d3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:18.235892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4651bb-0142-4621-942c-812f2c49639c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:18.237589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 593/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:35:18 2022] GET /identity/v3/projects/1af2be1a5974462fb6a125415cfad7d3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:18.244367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:18.344271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3f8d-ca19-4e57-8e2b-975c9beb2be4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:18.366078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:18.377886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:18.378487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:18.378763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:18.379032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:18.379803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=1af2be1a5974462fb6a125415cfad7d3, user.id=a24c6f97f85b449d895c34ced1085900) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:18.380108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:18.381561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348901-2fd8-4fd0-a135-144888d5e4f7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:18.386924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 592/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:35:18 2022] GET /identity/v3/role_assignments?user.id=a24c6f97f85b449d895c34ced1085900&scope.project.id=1af2be1a5974462fb6a125415cfad7d3&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:20.358916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2260b-7d50-4a75-87b5-b37bf1741562 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:20.359459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2260b-7d50-4a75-87b5-b37bf1741562 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:20.359459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2260b-7d50-4a75-87b5-b37bf1741562 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:20.360807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 594/1186] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:20.365871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:20.366296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:20.366426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:20.385555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:20.386730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:20.451685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 593/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:20.473001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2260b-7d50-4a75-87b5-b37bf1741562 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:20.573637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2260b-7d50-4a75-87b5-b37bf1741562 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:20.606218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:20.606843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:20.607125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:20.607399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:20.617355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:35:20.622238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:20.623418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:35:20.624536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 595/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:20.629306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:20.727114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5067d5-f078-417b-b0c8-060d4a9bb7d2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:20.742807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:20.760727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:20.761339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:20.761648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:20.761919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:20.762625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:20.762929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:20.764281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:20.772367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 594/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:20.778919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:20.825855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:20.877276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca10fb-415c-4e3e-ab0b-3fd295733a65 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:20.910766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:20.911398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:20.911684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:20.911958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] PATH_INFO: `/v3/users/a24c6f97f85b449d895c34ced1085900` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:20.913135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] RBAC: Authorizing `identity:get_user(user_id=a24c6f97f85b449d895c34ced1085900)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:20.914888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:20.916534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 596/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:35:20 2022] GET /identity/v3/users/a24c6f97f85b449d895c34ced1085900 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:20.922310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:21.020277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615537e8-6266-40e1-8b6f-64b2eef4586c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:21.052310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:21.052937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:21.053217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:21.053518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] PATH_INFO: `/v3/projects/1af2be1a5974462fb6a125415cfad7d3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:21.054658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] RBAC: Authorizing `identity:get_project(project_id=1af2be1a5974462fb6a125415cfad7d3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:21.056619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fd2b-a0aa-47dc-8d98-bef035471392 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:21.058259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 595/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:35:20 2022] GET /identity/v3/projects/1af2be1a5974462fb6a125415cfad7d3 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:21.064100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:21.161110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff6899-5151-47ca-a60e-ec751704bee8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:21.175407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:21.196084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:21.196774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:21.197050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:21.197321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] PATH_INFO: `/v3/projects/1af2be1a5974462fb6a125415cfad7d3/users/a24c6f97f85b449d895c34ced1085900/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:21.199240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af2be1a5974462fb6a125415cfad7d3, user_id=a24c6f97f85b449d895c34ced1085900, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:21.200643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996229f-4e22-4470-be08-a51185c5e0c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:21.212741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 597/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:35:21 2022] PUT /identity/v3/projects/1af2be1a5974462fb6a125415cfad7d3/users/a24c6f97f85b449d895c34ced1085900/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:35:23.155934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a550be-7881-484a-8f00-6c3e97388fa2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.156486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a550be-7881-484a-8f00-6c3e97388fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.156486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a550be-7881-484a-8f00-6c3e97388fa2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.158632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 596/1193] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:35:23.163925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.164342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.164470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.182781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:35:23.183947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:35:23.249257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 598/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:35:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:35:23.272337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a550be-7881-484a-8f00-6c3e97388fa2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:23.319257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:23.371468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a550be-7881-484a-8f00-6c3e97388fa2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:23.404009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:23.404632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.404905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.405172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.415333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:35:23.420075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:35:23.421152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:35:23.422233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 597/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:35:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:35:23.427366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:23.524203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396f898-4ae1-4180-97ab-23d9386eb354 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:23.527264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:23.558318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:23.558931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.559212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.559485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.560198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:23.560504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:23.561969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:23.569825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 599/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:23.576212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:23.671991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01166-78d7-42ef-b3cc-73df7392c5b4 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:23.678446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:23.704476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:23.705093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.705369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.705674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] PATH_INFO: `/v3/users/a24c6f97f85b449d895c34ced1085900` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.706805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] RBAC: Authorizing `identity:get_user(user_id=a24c6f97f85b449d895c34ced1085900)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:23.708215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:23.709803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 598/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Jul 29 11:35:23 2022] GET /identity/v3/users/a24c6f97f85b449d895c34ced1085900 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:23.716225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:23.815674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c6ea-1753-4d04-b154-65ead8c6ca00 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:23.848544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:23.849162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:23.849463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:23.849742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:23.882103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:23.918013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:23.919459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:24.013736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 600/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:35:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:35:24.019726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:24.115708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ad54-1bb2-4bd2-90c5-9126d142b088 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:24.147633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:24.148248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:24.148523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:24.148791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] PATH_INFO: `/v3/projects/1af2be1a5974462fb6a125415cfad7d3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:24.150233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] RBAC: Authorizing `identity:get_project(project_id=1af2be1a5974462fb6a125415cfad7d3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:24.151649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d07c5-39b6-4285-9211-b36551a36816 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:24.153251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 599/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Jul 29 11:35:24 2022] GET /identity/v3/projects/1af2be1a5974462fb6a125415cfad7d3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:24.159248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:35:24.222698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:24.257246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c7ef-8907-4839-bf28-796059e28dec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:35:24.290767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:35:24.291323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:35:24.291606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:35:24.291881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:35:24.292656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=1af2be1a5974462fb6a125415cfad7d3, user.id=a24c6f97f85b449d895c34ced1085900) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:35:24.292967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:35:24.294412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b1e85-1e1e-4e12-a0d4-3687c54a0284 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:35:24.300138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 601/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:35:24 2022] GET /identity/v3/role_assignments?user.id=a24c6f97f85b449d895c34ced1085900&scope.project.id=1af2be1a5974462fb6a125415cfad7d3&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:35:34.143678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=79 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:35:34.297484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=35 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:18.952934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4a4b-c249-40f6-b809-ba1161da6529 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:18.953562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4a4b-c249-40f6-b809-ba1161da6529 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:18.953677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4a4b-c249-40f6-b809-ba1161da6529 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:18.955128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 600/1201] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:18.964122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:18.964122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:18.964122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:18.982621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:18.984113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:19.064593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 602/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:19.091479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4a4b-c249-40f6-b809-ba1161da6529 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:19.232987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4a4b-c249-40f6-b809-ba1161da6529 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:19.283293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:19.283991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:19.284250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:19.284497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:19.299598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:19.301278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:19.318197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:19.319416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:19.321103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:19.321103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:19.321103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:19.321103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:19.321103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 601/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:19.325697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:19.449935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa479-b118-4542-9419-73bb56c15afd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:19.484583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:19.491482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:19.492547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:19.492998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:19.493274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:19.494015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:19.494319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:19.495678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd66e-a392-40c3-8d52-c23912352704 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:19.512598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 603/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:19.518561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:19.592796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:19.658428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba6d8f-f114-4ba6-a66e-9f34eeb54e58 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:19.697021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:19.697677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:19.697954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:19.698243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:19.698882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:19.700537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a314c-0ca6-41bc-8ea7-ffa08687f295 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:19.733863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 602/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Jul 29 11:36:19 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:36:21.883170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce538386-46e9-44c4-87c8-c7c24da8d1d2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:21.883767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce538386-46e9-44c4-87c8-c7c24da8d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:21.883854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce538386-46e9-44c4-87c8-c7c24da8d1d2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:21.885689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 604/1206] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:21.894139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:21.894668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:21.894879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:21.917836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:21.919462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:22.005559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 603/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:22.029912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce538386-46e9-44c4-87c8-c7c24da8d1d2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:22.151385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce538386-46e9-44c4-87c8-c7c24da8d1d2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:22.188993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:22.189681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:22.189966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:22.190244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:22.203863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:22.209730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:22.211652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:22.212522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 605/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:22.219732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:22.264297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:22.332822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d9a6a-ccaa-434d-b398-cab8384822fd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:22.378134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:22.378858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:22.379045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:22.379339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:22.380034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:22.380337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:22.381733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:22.390649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 604/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:22.396345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:22.451975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:22.516635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7438-8ba9-45f7-bafe-ed97e91c9fbf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:22.561574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:22.562236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:22.562520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:22.562798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:22.575981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:22.577671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:22.597322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:22.598522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:22.599520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:22.599520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:22.599520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:22.599520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:22.599520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 606/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:22.604568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:22.715872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:22.719636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c150cd8-8f2f-455e-a859-efb9c23dc4ea None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:22.763184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:22.763915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:22.764200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:22.764522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:22.765619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:22.766021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:22.767566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:22.782575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 605/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:22.789128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:22.921101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db05b-54a6-4d24-b9eb-03de5968f601 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:22.923028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:22.964252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:22.964922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:22.965208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:22.965522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:22.974838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:22.976775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:22.989005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:22.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:22.992045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 607/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:22.996968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:23.126577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9a6e-8428-42c4-8f5a-9d8a7b8af4d2 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:23.168450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:23.169236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:23.169627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:23.169968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:23.170862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:23.171239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:23.172747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:23.191139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 606/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:23.197098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:23.328812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e035b-a1a9-4874-9492-af1d545c6058 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:23.366715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:23.367550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:23.367799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:23.368275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:23.419362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:23.472045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:23.473568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:23.581648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 608/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:36:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:36:23.589964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:23.610136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:23.722158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322da03-a536-4e55-adc5-ef3532355dc8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:23.775337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:23.775992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:23.776276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:23.776548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:23.791654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:23.793559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:23.815226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:23.816410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:23.817532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:23.817532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:23.817532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:23.817532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:23.817532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 607/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:23.823295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:23.892797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:23.940736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afd8fa-f74c-4d71-adb3-5d594b7da0e6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:23.983563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:23.984338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:23.984622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:23.984895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:23.985613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:23.986022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:23.987649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:24.005442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 609/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:24.007263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:24.110822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:24.150027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638ec2-c53c-4b3b-8d7d-8584e11c94d8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:24.197391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:24.198010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:24.198320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:24.198590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:24.205850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:24.207309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:24.224380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:24.225536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:24.230415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 608/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:24.232117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:24.343316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37eb6b-5b15-4806-9a2b-a63cbe077e4f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:24.370875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:24.384120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:24.384753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:24.385035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:24.385340 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:24.386115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:24.386427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:24.388957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bbb80-b504-4071-97cd-66a092336638 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:24.405658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 610/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:24.407455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:24.521768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91b9b-61f9-4451-8dce-7138a8925ad1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:24.552680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:24.559866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:24.560486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:24.560765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:24.561033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:24.561835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=66151da3fa3a4bdb8816f74c7c434caf) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:24.562279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:24.563723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966ee8-52d6-4530-ae3d-7960a4eb7729 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:24.569317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 609/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:36:24 2022] GET /identity/v3/role_assignments?user.id=66151da3fa3a4bdb8816f74c7c434caf&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:26.670945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d794-cecb-4a2c-9cb4-67c13b438231 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:26.671488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d794-cecb-4a2c-9cb4-67c13b438231 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:26.671488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d794-cecb-4a2c-9cb4-67c13b438231 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:26.672917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 611/1220] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:26.678290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:26.678776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:26.678928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:26.697642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:26.698835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:26.773645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 610/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:26.799000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d794-cecb-4a2c-9cb4-67c13b438231 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:26.912253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d794-cecb-4a2c-9cb4-67c13b438231 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:26.947054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:26.947711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:26.948057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:26.948279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:26.958643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:26.964439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:26.965662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:26.972399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 612/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:26.973313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.081284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d39a8-3d4c-4126-9633-dafc1599cb09 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:27.105115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:27.115697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:27.116852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:27.117227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:27.117540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:27.118302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:27.118550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:27.119938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:27.128471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 611/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:27.135140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.190487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:27.249587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92e437-dd24-476a-aa99-bcdd9f7fbcc9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:27.284687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:27.285333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:27.285647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:27.285925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:27.296396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:27.297901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:27.313040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:27.314130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:27.315084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:27.315084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:27.315084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:27.315084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:27.315084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 613/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:27.321177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.431435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a169de-bfec-457e-9a47-32a209ae01e8 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:27.470009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:27.470636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:27.470917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:27.471190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:27.471878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:27.472180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:27.473577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:27.491854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 612/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:27.497638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.598953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:27.606764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697a2f-642f-42a2-9854-b1b31156b2cb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:27.642893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:27.643533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:27.643816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:27.644091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:27.655277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:27.656710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:27.670442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:27.671944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:27.673170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 614/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:27.677600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.725274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:27.783237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768d1e-b60f-45bd-b406-60d3e2a38f2b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:27.819805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:27.820499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:27.820772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:27.821041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:27.821855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:27.822156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:27.823630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:27.843245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 613/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:27.850020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:27.966734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55484-fc61-4cc8-97b0-8d0528bf0ff6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:28.006629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:28.008291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:28.008620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:28.008965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:28.023171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:28.024642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:28.040658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:28.041785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:28.042908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:28.042908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:28.042908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:28.042908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:28.042908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 615/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:28.046377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:28.150670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b50a-7fff-4799-8b56-6c73c958d5e7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:28.154585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:28.188459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:28.189075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:28.189353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:28.189657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:28.190675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:28.190675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:28.191999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:28.205914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 614/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:28.211375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:28.220959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:28.318893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825d0c-7966-4746-bcb2-e7f07c272694 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:28.360273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:28.360945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:28.361597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:28.361943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:28.370375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:28.371895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:28.384696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:28.386253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:28.387564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 616/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:28.392739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:28.513333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250b3cb-7258-425f-b69e-0815f12c1e8e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:28.551120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:28.551907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:28.552247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:28.552591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:28.553374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:28.554275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:28.556095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d8c66-b425-42ce-a965-37f08d035346 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:28.570452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 615/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:28.576904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:28.653195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:28.697579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f15f8-9831-47b8-97da-e24cd2e7d43a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:28.753823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:28.754639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:28.755018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:28.755392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/66151da3fa3a4bdb8816f74c7c434caf/roles/5304e58f3aee4f93bbd8865b52751c8f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:28.771915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=66151da3fa3a4bdb8816f74c7c434caf, role_id=5304e58f3aee4f93bbd8865b52751c8f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:28.773973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4a73-8bed-4e7c-af09-1be0e401e847 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:28.788027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 617/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:36:28 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/66151da3fa3a4bdb8816f74c7c434caf/roles/5304e58f3aee4f93bbd8865b52751c8f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:36:30.840768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fe19-a6f1-40a7-ad07-461cf1a788ea None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:30.841386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fe19-a6f1-40a7-ad07-461cf1a788ea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:30.841386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fe19-a6f1-40a7-ad07-461cf1a788ea None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:30.842984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 616/1233] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:36:30.848203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:30.848635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:30.848789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:30.868325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:30.869713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:30.942021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 618/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:30.964845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978fe19-a6f1-40a7-ad07-461cf1a788ea None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:30.992101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:31.070340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978fe19-a6f1-40a7-ad07-461cf1a788ea None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.104140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.104715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.104997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.105271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.115196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:31.120694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:31.122569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:31.123522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 617/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Jul 29 11:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:31.128271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:31.184554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:31.244472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0faac-3bd4-48a9-b784-550239a2d53e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.281479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.282107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.282426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.282655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.283404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:31.283705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:31.285050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:31.294712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 619/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Jul 29 11:36:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:31.300436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:31.391722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:31.408873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079641-d429-4024-8f5c-c9fe418ee818 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.447136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.447843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.448195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.448551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.459236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:31.460928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:31.476450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:31.477627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:31.478665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:31.478665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:31.478665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:31.478665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:31.478665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 618/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:31.483674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:31.598383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be25a-b824-499f-8820-5aa68cb7a505 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.608592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:31.635671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.636299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.636581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.636861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.637579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:31.637887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:31.639252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:31.651732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 620/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:31.657371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:31.764730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787096-21d6-4faf-9e87-be5b5f42378c None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.801907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.802556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.802839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.803112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.806716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:31.813006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:31.814581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:31.827276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:31.828459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:31.829574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 619/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:31.834945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:31.949973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16356bd-37ca-4e71-9af9-7d0d2f550de7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:31.988198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:31.988947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:31.989225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:31.989519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:31.990529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:31.990907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:31.993203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:32.013833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 621/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:32.020238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:32.132788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8323-7d4b-4692-807a-9e38e7b1e15a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:32.166980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:32.167606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:32.167888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:32.168162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:32.240034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:32.249200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:32.250707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:32.361710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 620/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:36:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:36:32.369182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:32.401480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:32.483619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef6b2-20a0-4d15-8580-68acbebd5d56 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:32.520875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:32.521460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:32.521845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:32.522120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:32.533875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:32.535339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:32.550583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:32.551506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:32.552403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:32.552403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:32.552403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:32.552403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:32.552403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 622/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:32.557788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:32.655570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:32.662324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5415-c83a-486c-bf68-b7094bf4796d None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:32.701300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:32.701963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:32.702241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:32.702513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:32.703194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:32.703495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:32.704865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:32.716572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 621/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:32.722420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:32.809813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:32.836486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08ce4-86c9-46c2-8b5f-1693aec039e1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:32.877246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:32.878041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:32.878325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:32.878661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:32.886631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:32.888086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:32.900815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:32.902109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:32.903171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 623/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:32.907979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:33.019296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db1e8-7e01-4bde-8347-35bc7268171f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:33.057865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:33.058598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:33.058896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:33.059229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:33.060174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:33.060545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:33.062157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ee27f-6057-4cfe-9e55-a67bb4e958ef None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:33.079257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 622/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:33.085432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:33.201215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08ac3-b5eb-4e90-9088-3a79505fd46f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:33.240001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:33.240693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:33.241168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:33.241505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:33.242295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] RBAC: Adding query filter params (role.id=5304e58f3aee4f93bbd8865b52751c8f, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=66151da3fa3a4bdb8816f74c7c434caf) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:33.242612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:33.244043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6313-a965-46ad-bd7b-6e56188f3979 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:33.250632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 624/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:36:33 2022] GET /identity/v3/role_assignments?user.id=66151da3fa3a4bdb8816f74c7c434caf&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=5304e58f3aee4f93bbd8865b52751c8f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:35.474008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d444-3e5d-4af5-8b91-afcc7641c6b2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:35.474546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d444-3e5d-4af5-8b91-afcc7641c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:35.474546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d444-3e5d-4af5-8b91-afcc7641c6b2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:35.476766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 623/1247] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:35.482801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:35.483256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:35.483364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:35.489820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:35.502990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:35.504219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:35.575532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 625/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:35.599497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d444-3e5d-4af5-8b91-afcc7641c6b2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:35.619860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:35.714486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d444-3e5d-4af5-8b91-afcc7641c6b2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:35.752287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:35.752855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:35.753143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:35.753435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:35.764721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:35.769944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:35.771094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:35.772043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 624/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:35.777701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:35.896414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73727b3-cdd2-4167-a203-e71f072ded40 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:35.931037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:35.936679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:35.937310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:35.937628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:35.937904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:35.938678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:35.938986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:35.940374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:35.949034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 626/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:35.954940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:36.041509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:36.068291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abab2e1-d895-4b6f-95d9-1c8886f3e9ee None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:36.107578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:36.108218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:36.108494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:36.108829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:36.123814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:36.125268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:36.141625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:36.142841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:36.143940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:36.143940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:36.143940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:36.143940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:36.143940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 625/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:36.149134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:36.266740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7243fa-967f-4689-ada2-cecc041391ce None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:36.304762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:36.305372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:36.305689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:36.306012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:36.306767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:36.307049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:36.308539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:36.322252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 627/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:36.327901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:36.442241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf9ea-c55f-4af9-9446-b5bcaa7e28f1 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:36.470577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:36.480358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:36.481087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:36.481297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:36.481585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:36.489275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:36.492770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:36.506085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:36.512167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:36.513564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 626/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:36.514393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:36.577823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:36.628600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4b59-025c-4b2b-ac5c-1c5fcaf3e3c1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:36.668115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:36.668775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:36.669027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:36.669305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:36.670137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:36.670450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:36.671923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:36.690277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 628/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:36.696705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:36.804973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d8fa1-8768-4a2f-8a25-f8f33766dd76 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:36.841987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:36.842543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:36.842836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:36.843109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:36.909074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:36.924578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:36.926088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.039869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 627/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:36:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:36:37.041087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:37.161985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56ad1-1b63-4d8d-8f90-24b359df43c1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:37.181810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:37.204138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:37.204782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:37.205064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:37.205339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:37.215211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:37.216654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:37.231412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:37.232530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:37.233586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:37.233586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:37.233586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:37.233586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:37.233586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 629/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:37.239070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:37.339193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:37.352521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f8b8-b590-4656-960a-e2d613a67f7f None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:37.393130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:37.393836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:37.394157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:37.394522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:37.395204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:37.395513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:37.397025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.409511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 628/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:37.416477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:37.529638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cb03a-ac18-454c-b081-ffd4e7de88bd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:37.564197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:37.564935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:37.565217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:37.565530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:37.572910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:37.574516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:37.589709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:37.590859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:37.591980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:37.595854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 630/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:37.597061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:37.707545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2db9c-a0b0-4b02-b264-acd184ebf22e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:37.742993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:37.743690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:37.743934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:37.744222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:37.744949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:37.745252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:37.746750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6eb3-f94b-4d6c-a158-76a0ead191e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.760175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 629/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:37.766887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:37.796624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:37.880746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fad09-7741-49f2-b970-1c48500bfa4f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:37.920520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:37.921144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:37.921449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:37.921732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:37.922517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=66151da3fa3a4bdb8816f74c7c434caf) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:37.922887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:37.924335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301bff-3552-4c65-a585-2ab42afe6b6d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:37.929851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 631/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:36:37 2022] GET /identity/v3/role_assignments?user.id=66151da3fa3a4bdb8816f74c7c434caf&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:39.968850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550ad9-b333-4767-9a1b-ada94e57e779 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:39.969493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550ad9-b333-4767-9a1b-ada94e57e779 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:39.969493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550ad9-b333-4767-9a1b-ada94e57e779 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:39.970743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 630/1261] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:39.975800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:39.976190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:39.976357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:39.994239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:39.995419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:40.060489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 632/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:40.082727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550ad9-b333-4767-9a1b-ada94e57e779 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.093326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:40.183459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550ad9-b333-4767-9a1b-ada94e57e779 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:40.216573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:40.217207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:40.217517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:40.217790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:40.228308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:40.233141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:40.234303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:40.235502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 631/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:40.240272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.258766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:40.338027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b62f-d375-4630-acb1-72e496c5ed89 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:40.371178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:40.371788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:40.372069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:40.372344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:40.373045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:40.373351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:40.374736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:40.383105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 633/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:40.388829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.454260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:40.487019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708262eb-7520-46e0-bf2f-3f62d370cff6 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:40.520113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:40.520743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:40.521027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:40.521301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:40.531687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:40.533130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:40.547524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:40.548518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:40.549558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:40.549558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:40.549558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:40.549558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:40.549558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 632/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:40.554976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.634541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:40.653087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732716c-99b5-48a3-9f5d-9e8e18ff2cc5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:40.686172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:40.686779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:40.687060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:40.687336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:40.688011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:40.688315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:40.689687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:40.701323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 634/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:40.706818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.803919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420849-398d-46d0-91db-1c35d7689d07 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:40.822986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:40.836719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158993f-6946-4369-903b-28f604522f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:40.837340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158993f-6946-4369-903b-28f604522f8a None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:40.837647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158993f-6946-4369-903b-28f604522f8a None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:40.837918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158993f-6946-4369-903b-28f604522f8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:40.846195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158993f-6946-4369-903b-28f604522f8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:40.848091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158993f-6946-4369-903b-28f604522f8a None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-3158993f-6946-4369-903b-28f604522f8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:40.862440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:40.863853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:40.865073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 633/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:40.870483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:40.978283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823461d-3b46-4133-a95f-30fa1f843f0d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.011477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.012092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.012367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.012637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.013441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:41.013746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.015167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.024260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:41.033488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 635/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:41.039810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158993f-6946-4369-903b-28f604522f8a None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:41.137490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158993f-6946-4369-903b-28f604522f8a None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.169975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.170596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.170878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.171151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.182017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.183454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:41.198471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:41.199499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:41.200685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:41.200685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:41.200685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:41.200685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:41.200685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 634/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 11:36:41.205318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:41.301208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89546e18-a9cb-4c4d-8f42-16bd3977a1f4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.334556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.335180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.335457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.335728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.336406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:41.336705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.338104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.348893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 636/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:41.354668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:41.386319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:41.453427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85188d-6b9c-474b-abf2-0f2a6411ae8b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.486385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.487046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.487328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.487602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.494690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.496127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:41.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:41.508719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:41.510038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 635/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:41.514569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:41.571695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:41.612512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320896f1-d7ed-43f9-afae-4d58887030ff None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.645641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.646252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.646534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.646809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.647679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:41.647984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.649400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3c1fd-97d1-4ef7-a429-13db367c9185 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.660968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 637/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:41.667459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:41.761946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:41.771626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f444b-1a31-4fa3-affa-d80c412527fc None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:41.804340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:41.804997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:41.805270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:41.805570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] PATH_INFO: `/v3/projects/48c0d67622e74258923a990b0f44ef02/users/66151da3fa3a4bdb8816f74c7c434caf/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:41.807453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c0d67622e74258923a990b0f44ef02, user_id=66151da3fa3a4bdb8816f74c7c434caf, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:41.808877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfedca6-245f-4934-8184-249495f7a1d0 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:41.820801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 636/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Jul 29 11:36:41 2022] PUT /identity/v3/projects/48c0d67622e74258923a990b0f44ef02/users/66151da3fa3a4bdb8816f74c7c434caf/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:36:43.775682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe637-e3f3-425a-bb62-3ff0dec5e97c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:43.776206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe637-e3f3-425a-bb62-3ff0dec5e97c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:43.776206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe637-e3f3-425a-bb62-3ff0dec5e97c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:43.777592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 638/1274] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:43.782600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:43.783012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:43.783150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:43.801898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:43.803080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:43.878397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 637/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:43.903829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fe637-e3f3-425a-bb62-3ff0dec5e97c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.004418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fe637-e3f3-425a-bb62-3ff0dec5e97c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.021475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:44.038733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.039299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.039575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.039843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.049652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 11:36:44.055011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:44.056140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:44.057201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 639/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Jul 29 11:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:44.064257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.143132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:44.161152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef7bd-6296-41db-bddc-1409b6c47d31 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.195150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.195766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.196040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.196337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.197043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:44.197342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:44.198732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:44.206680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 638/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:44.212473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.309700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3cfb9-16bb-44bb-87fa-ce62e5884a25 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.342454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.343082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.343365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.343642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.353441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:44.354874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:44.369759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:44.370785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:44.371882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:44.371882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:44.371882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:44.371882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:44.372225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 640/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:44.382354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.479063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada18b-7103-4909-8bb9-c7850b7f10e7 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.510963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.511562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.511841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.512111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.512783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:44.513083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:44.514475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:44.525881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 639/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:44.531455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.564212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:44.631313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936fd7-33c2-4f1e-b360-040d2a697ccf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.663975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.664596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.664877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.665148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.672302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:44.673754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 11:36:44.686181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:44.687311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:44.688310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 641/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:44.693060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.696868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:44.791344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5287-05f1-494b-899c-12329eb91053 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.823776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.824330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.824613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.824888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:44.825701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:44.826011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:44.827437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:44.845344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 640/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:44.850755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:44.943073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:44.953385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ddb4-ebe5-4992-b92c-2de0883dabbc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:44.985653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:44.986264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:44.986548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:44.986824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.053026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.054979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.139451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:45.150064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 642/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Jul 29 11:36:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 11:36:45.156039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:45.216331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:45.253525 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcf627-3d4a-4314-b3a5-753148fb8349 None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:45.286890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:45.287523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:45.287804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:45.288077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.297769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.299221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 11:36:45.313583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:45.314666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:45.315809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 11:36:45.315809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 11:36:45.315809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 11:36:45.315809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:45.315809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 641/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:45.321229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:45.417275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d258-1bbc-4b1a-a35d-1f0cb7bbaa14 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:45.449983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:45.450595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:45.450877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:45.451150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.451825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:45.452129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.453507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.464535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 643/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Jul 29 11:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:45.470137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:45.568841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486811b-7529-483f-8f41-a39072bf897e None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:45.582030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:45.603008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:45.603641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:45.603922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:45.604193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.610609 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.612062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 11:36:45.623110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:45.624146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: ERROR keystone.server.flask.application Jul 29 11:36:45.625284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 642/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Jul 29 11:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:45.630198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:45.678980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:45.728446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0044a-2b1d-407a-8c36-c814d467dd88 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:45.760707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:45.761316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:45.761629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:45.761906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.762648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:45.762955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.764377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634713-7db7-478e-86b1-1b761bed19cf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.777514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 644/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Jul 29 11:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:45.783673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:45.890779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfb89-6c48-4fc0-83e7-bbe172d4386b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:45.923317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:45.923930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:45.924211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:45.924490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:45.925265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] RBAC: Adding query filter params (role.id=49c473efb0f54f149c348fb507115880, scope.project.id=48c0d67622e74258923a990b0f44ef02, user.id=66151da3fa3a4bdb8816f74c7c434caf) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:45.925605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:45.927030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e139be-ff53-44e2-a578-0bea9f830fbf None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:45.932971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 643/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Jul 29 11:36:45 2022] GET /identity/v3/role_assignments?user.id=66151da3fa3a4bdb8816f74c7c434caf&scope.project.id=48c0d67622e74258923a990b0f44ef02&role.id=49c473efb0f54f149c348fb507115880 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:47.918820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600131d-45e7-4503-bee1-d8657d94ea00 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:47.919350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600131d-45e7-4503-bee1-d8657d94ea00 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:47.919350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600131d-45e7-4503-bee1-d8657d94ea00 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:47.920706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 645/1288] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:47.925700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:47.926083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:47.926260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:47.944983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:47.946194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:47.974824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:48.012072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 644/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:48.033475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600131d-45e7-4503-bee1-d8657d94ea00 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:48.133267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600131d-45e7-4503-bee1-d8657d94ea00 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:48.143854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:48.167360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:48.167988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:48.168269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:48.168544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] PATH_INFO: `/v3/services/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:48.169210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:48.170553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:48.179881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:48.181107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:48.181986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 646/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:36:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:48.187142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:48.283293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963703a-9f83-488c-994b-4e18be877a9d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:48.317268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:48.317906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:48.318187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:48.318461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:48.319783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:48.320090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:48.321495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786aaaf-2c94-445c-ae4e-009e96b4c893 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:48.326176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 645/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Jul 29 11:36:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:48.332075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:48.431247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dad3-b166-421f-864d-2880fd86c36a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:48.463638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:48.464239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:48.464523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:48.464796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:48.465481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] RBAC: Adding query filter params (type=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:48.465797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:48.467146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92246eb-6599-4244-a4e2-9a163e10da4f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:48.471448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 647/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Jul 29 11:36:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:50.457300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb5848-90b6-4d8d-aa39-c2063c4d0eb2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:50.457896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb5848-90b6-4d8d-aa39-c2063c4d0eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:50.457896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb5848-90b6-4d8d-aa39-c2063c4d0eb2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:50.459130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 646/1293] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:50.464925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989cfa8-b8d1-4096-b907-06e6e94bc938 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:50.465316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989cfa8-b8d1-4096-b907-06e6e94bc938 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:50.465508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989cfa8-b8d1-4096-b907-06e6e94bc938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:50.483278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f989cfa8-b8d1-4096-b907-06e6e94bc938 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:50.484457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f989cfa8-b8d1-4096-b907-06e6e94bc938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:50.513085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:50.550377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 648/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:50.572688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb5848-90b6-4d8d-aa39-c2063c4d0eb2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:50.603508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:50.672891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb5848-90b6-4d8d-aa39-c2063c4d0eb2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:50.705828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:50.706432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:50.706719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:50.706991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:50.707731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:50.709046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae8ae-4b39-450f-89af-d73797af0833 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:50.722602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 647/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Jul 29 11:36:50 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:36:52.711973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bff58-a87d-46f1-ad33-29237baf037a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:52.712486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bff58-a87d-46f1-ad33-29237baf037a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:52.712595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bff58-a87d-46f1-ad33-29237baf037a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:52.713912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 649/1296] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:52.718945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:52.719334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:52.719493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:52.737490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:52.738686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:52.810709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 648/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:52.833336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bff58-a87d-46f1-ad33-29237baf037a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:52.940514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bff58-a87d-46f1-ad33-29237baf037a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:52.973580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:52.974146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:52.974421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:52.974728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:52.975634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:52.976978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:52.985566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:52.986802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:52.987890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 650/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:36:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:52.992886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:53.011484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:53.092107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018ccb4-8ccf-48b4-abe6-57f8c9be4a06 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:53.124730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:53.125339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:53.125646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:53.125922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:53.126588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:53.126885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:53.128236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:53.134001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 649/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Jul 29 11:36:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:53.140022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:53.170786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:53.239021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7d384-ae93-4a79-bdd4-daf6a1832290 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:53.272419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:53.273031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:53.273310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:53.273608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:53.274348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] RBAC: Adding query filter params (interface=public, service_id=e04d84d9887f47848d19f715efd16cf2, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:53.274653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:53.276005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22c614-ebf3-4167-9c13-9310cbd60329 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:53.280809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 651/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Jul 29 11:36:53 2022] GET /identity/v3/endpoints?service_id=e04d84d9887f47848d19f715efd16cf2&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:36:53.286629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:53.366479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:53.384553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414602af-73ce-45e9-b432-b1f596de753b None admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:53.417776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:53.418384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:53.418659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:53.418927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:53.419563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:53.420909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9d6-9a2c-4304-8885-698e7113ccc7 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:53.427415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 650/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Jul 29 11:36:53 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:36:55.391126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d524-1f76-4fbc-b709-f0652e817c28 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:55.391670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d524-1f76-4fbc-b709-f0652e817c28 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:55.391771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4d524-1f76-4fbc-b709-f0652e817c28 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:55.393069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 652/1302] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:36:55.398927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:55.399350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:55.399443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:55.417577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:36:55.418749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:36:55.482744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 651/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:36:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 11:36:55.504517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4d524-1f76-4fbc-b709-f0652e817c28 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:55.598662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:55.606361 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4d524-1f76-4fbc-b709-f0652e817c28 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:55.639109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:55.639745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:55.640026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:55.640298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:55.641173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:55.642565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 11:36:55.651829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 11:36:55.653005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 29 11:36:55.654282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 653/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Jul 29 11:36:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 11:36:55.659017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:55.731884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:36:55.754124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8f08f-3611-4e0e-a87e-376eddfdcc78 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:55.787670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:55.788269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:55.788548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:55.788818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] PATH_INFO: `/v3/services` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:55.789509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:36:55.789811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:55.791166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e52fc-835f-4f8b-9335-aa4abd053576 None admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:55.796092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 652/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Jul 29 11:36:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:36:55.801862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:36:55.904818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4fb5-a881-48b3-8a14-6ef09a5b2718 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:36:55.936980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:36:55.937611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:36:55.937888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:36:55.938153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:36:55.938845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:36:55.940190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25d0b-57b5-4ce8-b769-ba83eb88a623 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:36:55.959013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 654/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:36:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:37:05.793591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=30 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:37:05.954854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:37:58.666013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c912e3-d7a8-4712-87d1-26d1d6a7ebbd None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:37:58.667131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c912e3-d7a8-4712-87d1-26d1d6a7ebbd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:37:58.667767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c912e3-d7a8-4712-87d1-26d1d6a7ebbd None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:37:58.669726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 653/1307] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:37:58.674617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fefb5-2cd1-4354-85f0-a9180b95d892 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:37:58.675064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fefb5-2cd1-4354-85f0-a9180b95d892 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:37:58.675164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fefb5-2cd1-4354-85f0-a9180b95d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:37:58.762305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3d4fefb5-2cd1-4354-85f0-a9180b95d892 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:37:58.763497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3d4fefb5-2cd1-4354-85f0-a9180b95d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:37:58.882345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 655/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:37:58.933195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:37:58.933359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:37:58.934019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:37:58.936470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 654/1309] 10.222.0.60 () {54 vars in 965 bytes} [Fri Jul 29 11:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:37:58.942764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabc53-be9f-4974-be4a-1ad4d4271700 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:37:58.943061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabc53-be9f-4974-be4a-1ad4d4271700 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:37:58.943331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabc53-be9f-4974-be4a-1ad4d4271700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:37:59.053313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-29dabc53-be9f-4974-be4a-1ad4d4271700 None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:37:59.058144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-29dabc53-be9f-4974-be4a-1ad4d4271700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:37:59.103431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:37:59.189437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 656/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Jul 29 11:37:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:37:59.200613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:37:59.202539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:37:59.325442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d2eb-e5f1-491d-ab36-54c98cc1165d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:37:59.402469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:37:59.403091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:37:59.403366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:37:59.403635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:37:59.405224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:37:59.460282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:37:59.519864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:37:59.521376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288c6ba-9b72-4263-af7b-f6edaa55b31c service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:37:59.541406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 655/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:01.830088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:01.830668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:01.830914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:01.832617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 657/1312] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:01.837685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c120-a142-4f8c-85ae-4a0925ddec42 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:01.838110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c120-a142-4f8c-85ae-4a0925ddec42 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:01.838282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c120-a142-4f8c-85ae-4a0925ddec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:01.913098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5413c120-a142-4f8c-85ae-4a0925ddec42 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:01.914356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5413c120-a142-4f8c-85ae-4a0925ddec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:02.026769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 656/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:02.066148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:02.068611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:02.196349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e535-3a88-44fc-a99a-a998923da74e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:02.287782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:02.290823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:02.291554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:02.292217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:02.292690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:02.295299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:02.424834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:02.426978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0a93a-6156-401c-87f3-5024b5c66e83 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:02.450741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 658/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:04.755086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:04.755644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:04.755644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:04.756950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 657/1315] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:04.762009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efecf2f-4858-4327-93b9-5cfe7342dd1a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:04.762452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efecf2f-4858-4327-93b9-5cfe7342dd1a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:04.762559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efecf2f-4858-4327-93b9-5cfe7342dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:04.827976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8efecf2f-4858-4327-93b9-5cfe7342dd1a None None] MFA Rules not processed for user `02c848f5b953440fb481cbbd44edd421`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:04.829119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8efecf2f-4858-4327-93b9-5cfe7342dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:04.881921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:04.926913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 659/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:04.965220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:04.966811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:04.977170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:05.069276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ce3f-2ea4-48ae-96e1-85a3096b61de None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:05.140546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:05.141354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:05.141659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:05.141928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:05.143544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:05.205075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:05.251390 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:05.252816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b463b3-1384-4d19-a2a6-ead5407ba9ba service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:05.273034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 658/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:07.819796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d73-94a7-4e64-8c49-397026987057 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:07.820336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d73-94a7-4e64-8c49-397026987057 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:07.820336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d73-94a7-4e64-8c49-397026987057 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:07.821811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 660/1318] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:07.826944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281536bc-b673-4ab6-8e6f-29927dc0772b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:07.827368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281536bc-b673-4ab6-8e6f-29927dc0772b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:07.827495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281536bc-b673-4ab6-8e6f-29927dc0772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:07.892468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-281536bc-b673-4ab6-8e6f-29927dc0772b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:07.893728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-281536bc-b673-4ab6-8e6f-29927dc0772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:07.989671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 659/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:08.028546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251d73-94a7-4e64-8c49-397026987057 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:08.030133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-77251d73-94a7-4e64-8c49-397026987057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:08.133286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251d73-94a7-4e64-8c49-397026987057 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:08.206458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:08.207076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:08.207355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:08.207625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:08.209242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:08.216693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:08.318617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:08.320723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166efc0b-793a-4cde-b53a-ba840ffba525 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:08.339667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 661/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:11.088634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69619e-ede7-4b12-8e34-dee16772fe87 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:11.089183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69619e-ede7-4b12-8e34-dee16772fe87 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:11.089183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69619e-ede7-4b12-8e34-dee16772fe87 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:11.090958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 660/1321] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:11.096750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502509-edf9-448b-990b-112d79b550e2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:11.097231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502509-edf9-448b-990b-112d79b550e2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:11.097556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502509-edf9-448b-990b-112d79b550e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:11.169190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65502509-edf9-448b-990b-112d79b550e2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:11.170435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65502509-edf9-448b-990b-112d79b550e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:11.235593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:11.278879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 662/1322] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:38:11.332246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:11.332539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:11.332812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:11.334309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 661/1323] 10.222.0.60 () {54 vars in 965 bytes} [Fri Jul 29 11:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:11.341006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f843-2829-4620-84aa-070e76179f6b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:11.341201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f843-2829-4620-84aa-070e76179f6b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:11.341528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f843-2829-4620-84aa-070e76179f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:11.424391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0508f843-2829-4620-84aa-070e76179f6b None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:11.426378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0508f843-2829-4620-84aa-070e76179f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:11.502073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 663/1324] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Jul 29 11:38:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:11.511762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:11.513314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:11.533261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:11.616694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de188-3f61-485e-a1b2-0b40dee062c2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:11.689262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:11.689919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:11.690206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:11.690476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:11.692596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:11.763984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:11.802756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:11.804362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4c94f-795c-49d0-a385-71ccd6ef2d06 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:11.822722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 662/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:14.099436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:14.099985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:14.100111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:14.101510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 664/1326] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:14.107260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4088-2179-4f3e-a6ef-58d3d93219b4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:14.107738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4088-2179-4f3e-a6ef-58d3d93219b4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:14.107829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4088-2179-4f3e-a6ef-58d3d93219b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:14.177206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ea4e4088-2179-4f3e-a6ef-58d3d93219b4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:14.178463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ea4e4088-2179-4f3e-a6ef-58d3d93219b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:14.285372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 663/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:14.319550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:14.321094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:14.384343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:14.428726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d7613-fd86-499d-a975-d08a55ed4c92 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:14.502873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:14.503736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:14.504033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:14.504298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:14.506472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:14.613258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:14.615418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:14.617560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabfb25-8304-4d86-b540-2cb8c58f137c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:14.636415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 665/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:16.678990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:16.679517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:16.679517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:16.680800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 664/1329] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:16.686055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2c7c-ba2d-4046-8355-4564e38e3859 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:16.686476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2c7c-ba2d-4046-8355-4564e38e3859 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:16.686610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2c7c-ba2d-4046-8355-4564e38e3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:16.755285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e26e2c7c-ba2d-4046-8355-4564e38e3859 None None] MFA Rules not processed for user `02c848f5b953440fb481cbbd44edd421`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:16.756520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e26e2c7c-ba2d-4046-8355-4564e38e3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:16.859676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 666/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:16.903773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:16.905517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:16.939966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:17.020743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c084b-f8d1-42b9-abf0-5e9799f64767 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:17.093567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:17.094188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:17.094467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:17.094735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:17.096343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:17.172209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:17.207126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:17.208568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6944-43c8-4a69-8ca5-4c3d8dbe513b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:17.226178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 665/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:19.646546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:19.647050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:19.647050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:19.648382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 667/1332] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:19.653450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed52a-ddf4-42ce-a28b-6b32b463a0d3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:19.653851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed52a-ddf4-42ce-a28b-6b32b463a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:19.654016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed52a-ddf4-42ce-a28b-6b32b463a0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:19.718864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-09aed52a-ddf4-42ce-a28b-6b32b463a0d3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:19.720059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-09aed52a-ddf4-42ce-a28b-6b32b463a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:19.815991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 666/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:19.852475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:19.854313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:19.923114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:19.957586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539767e-6b0a-4ed2-a8e3-2c7e2dee67fb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:20.030104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:20.030723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:20.031001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:20.031272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:20.032888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:20.163989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:20.165488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e8181-401a-444b-b2e6-4bc9fe599208 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:20.180310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:20.188918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 668/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:22.239291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:22.239817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:22.239817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:22.241167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 667/1335] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:22.246380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2cc3-e3ee-41d6-b562-474c043d0950 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:22.246828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2cc3-e3ee-41d6-b562-474c043d0950 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:22.246932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2cc3-e3ee-41d6-b562-474c043d0950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:22.320364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d3a2cc3-e3ee-41d6-b562-474c043d0950 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:22.321590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d3a2cc3-e3ee-41d6-b562-474c043d0950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:22.416500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 669/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:22.456852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:22.458447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:22.498611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:22.563682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af666d1b-0a8d-4122-9398-68271807dcd5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:22.635628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:22.636237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:22.636511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:22.636779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:22.638397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:22.719961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:22.744882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:22.746365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec9a2-d49d-4ca6-a72b-4e4c45b6c747 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:22.764554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 668/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:25.103703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:25.104266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:25.104266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:25.105678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 670/1338] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:25.111039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438809a-bc2a-45b1-9556-e99fca2de0d0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:25.111466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438809a-bc2a-45b1-9556-e99fca2de0d0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:25.111596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438809a-bc2a-45b1-9556-e99fca2de0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:25.177901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5438809a-bc2a-45b1-9556-e99fca2de0d0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:25.179111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5438809a-bc2a-45b1-9556-e99fca2de0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:25.276365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 669/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:25.312287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:25.313868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:25.391948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:25.419807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3155ed-42d4-4794-a638-837106e99e56 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:25.492255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:25.492874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:25.493156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:25.493454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:25.495064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:25.602912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:25.604340 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a418b-71cd-49cf-ad6c-cc4200f7f454 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:25.622647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 671/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:29.599056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:29.599608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:29.599608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:29.600843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 670/1341] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:29.605966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63134-f18e-47d3-b95b-89502747de5f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:29.606487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63134-f18e-47d3-b95b-89502747de5f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:29.606595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63134-f18e-47d3-b95b-89502747de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:29.612034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:29.675010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-78e63134-f18e-47d3-b95b-89502747de5f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:29.676352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78e63134-f18e-47d3-b95b-89502747de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:29.771563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 672/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:29.810317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:29.811823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:29.859827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:29.916336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e70128-602c-4a05-94c9-dcee3ff8a7af None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:29.991916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:29.992603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:29.992881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:29.993155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:29.994869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:30.087191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:30.103874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:30.105318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871125c2-1b44-4526-89dd-35c00338579a service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:30.123866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 671/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:32.792546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:32.793120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:32.793221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:32.794791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 673/1344] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:32.800693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683541b-7313-4371-80f6-603bf49e2659 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:32.801206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683541b-7313-4371-80f6-603bf49e2659 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:32.801298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683541b-7313-4371-80f6-603bf49e2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:32.874975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1683541b-7313-4371-80f6-603bf49e2659 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:32.876231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1683541b-7313-4371-80f6-603bf49e2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:32.974451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 672/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:33.010908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:33.012441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:33.099848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:33.117245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813d37-3c46-4aea-bc39-a130e73ca501 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:33.196391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:33.197135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:33.197430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:33.197707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:33.199382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:33.308415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:33.309875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6856f5-52f9-4b06-b9a2-d5baf2bc5059 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:33.327928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 674/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:37.366497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:37.367031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:37.367202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:37.368615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 673/1347] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:37.374020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63959-dd9a-410d-bcca-e66012c36d05 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:37.374498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63959-dd9a-410d-bcca-e66012c36d05 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:37.374712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63959-dd9a-410d-bcca-e66012c36d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:37.391422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:37.446155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dfc63959-dd9a-410d-bcca-e66012c36d05 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:37.447304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dfc63959-dd9a-410d-bcca-e66012c36d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:37.570779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 675/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:37.609498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:37.611277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:37.673576 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:37.722976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c20d7-f920-4e2b-91d4-8d2334711ea6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:37.799707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:37.800341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:37.800623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:37.800904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:37.802568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:37.934602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:37.940386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:37.942581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69ad28-c7c5-4180-ab9a-a3646485a67b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:37.969310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 674/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:42.969154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b719b-082d-4851-8ebf-e291ef8ce5cc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:42.969154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b719b-082d-4851-8ebf-e291ef8ce5cc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:42.969154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b719b-082d-4851-8ebf-e291ef8ce5cc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:42.970854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 676/1350] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:42.976233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bdb9b-db23-43a7-8db5-690f5aa6bee0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:42.976979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bdb9b-db23-43a7-8db5-690f5aa6bee0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:42.977431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bdb9b-db23-43a7-8db5-690f5aa6bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:43.065536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e57bdb9b-db23-43a7-8db5-690f5aa6bee0 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:43.066929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e57bdb9b-db23-43a7-8db5-690f5aa6bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:43.197768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 675/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:38:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:47.300886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf57d-5bad-4fce-8357-8359d4cff138 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:47.301402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf57d-5bad-4fce-8357-8359d4cff138 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:47.301848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf57d-5bad-4fce-8357-8359d4cff138 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:47.303823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 677/1352] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:38:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:47.308801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8d39-ef12-451a-af0d-44c11cbf1866 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:47.309241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8d39-ef12-451a-af0d-44c11cbf1866 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:47.309346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8d39-ef12-451a-af0d-44c11cbf1866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:47.367612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:47.393692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b69b8d39-ef12-451a-af0d-44c11cbf1866 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:47.394934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b69b8d39-ef12-451a-af0d-44c11cbf1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:47.509497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 676/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:38:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:47.568778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=59 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:48.840549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864df8b-7773-461c-b12a-69b4951f3c17 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:48.841182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864df8b-7773-461c-b12a-69b4951f3c17 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:48.841182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864df8b-7773-461c-b12a-69b4951f3c17 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:48.842450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 678/1354] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:48.847881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e30-43ec-4394-bb64-be154e8d6399 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:48.848320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e30-43ec-4394-bb64-be154e8d6399 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:48.848590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e30-43ec-4394-bb64-be154e8d6399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:48.926497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-db980e30-43ec-4394-bb64-be154e8d6399 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:48.927686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-db980e30-43ec-4394-bb64-be154e8d6399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:48.968706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:49.036140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 677/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:38:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:38:52.425260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0518e-47f7-499c-8a40-53e4c444f5d0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:52.425811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0518e-47f7-499c-8a40-53e4c444f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:52.425928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0518e-47f7-499c-8a40-53e4c444f5d0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:52.427243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 679/1356] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:52.433546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136ba-2b85-4c2a-a535-29febc36f2cf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:52.433546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136ba-2b85-4c2a-a535-29febc36f2cf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:52.433546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136ba-2b85-4c2a-a535-29febc36f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:52.526721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-588136ba-2b85-4c2a-a535-29febc36f2cf None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:52.527934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-588136ba-2b85-4c2a-a535-29febc36f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:52.641130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 678/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:38:52.720886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:52.721314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:52.721448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:52.723057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 680/1358] 10.222.0.60 () {54 vars in 962 bytes} [Fri Jul 29 11:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:52.729010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa9f0-4390-4d1c-a6df-115a893349ce None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:52.729301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa9f0-4390-4d1c-a6df-115a893349ce None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:52.729613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa9f0-4390-4d1c-a6df-115a893349ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:52.747304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:52.819798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-563fa9f0-4390-4d1c-a6df-115a893349ce None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:52.820908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-563fa9f0-4390-4d1c-a6df-115a893349ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:52.944688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 679/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Jul 29 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:52.952358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:52.953892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:53.105664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca7a3-2774-4fc0-8c7a-26372d45d10f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:53.188848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:53.239800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:53.240706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:53.241192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:53.241640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:53.243257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:53.339183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:53.340936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a191b-798f-41c7-b257-1b85dbb9ed54 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:53.359903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 681/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:55.601536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:55.602127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:55.602127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:55.603580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 680/1361] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:55.608946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f667be-a392-4c8d-88f2-fa3cee5a1ecd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:55.609403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f667be-a392-4c8d-88f2-fa3cee5a1ecd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:55.609668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f667be-a392-4c8d-88f2-fa3cee5a1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:55.677764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-27f667be-a392-4c8d-88f2-fa3cee5a1ecd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:55.679169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-27f667be-a392-4c8d-88f2-fa3cee5a1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:55.719836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:55.793891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 682/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:38:55.841722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:55.843431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:55.931441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.021280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90217c-5947-4104-a212-0f78b6057e16 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:56.179951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:56.180586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:56.180866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:56.181134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:56.182821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:56.210735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.285778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:56.287396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698aef91-e84a-4aab-95f8-84de644f2fcd service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:56.309274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 681/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:38:58.692142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbda8f-3624-49dc-bfbe-18195b396318 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:58.694646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbda8f-3624-49dc-bfbe-18195b396318 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:58.696021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbda8f-3624-49dc-bfbe-18195b396318 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:58.698859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 683/1364] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:38:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:58.703395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe520fad-7222-47b0-a8c8-cc7f431a00bd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:58.703900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe520fad-7222-47b0-a8c8-cc7f431a00bd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:58.704038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe520fad-7222-47b0-a8c8-cc7f431a00bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:58.784433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fe520fad-7222-47b0-a8c8-cc7f431a00bd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:58.786578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fe520fad-7222-47b0-a8c8-cc7f431a00bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:58.898072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:58.905111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 682/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:38:58.947955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:58.948656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:58.949088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:58.951097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 684/1366] 10.222.0.60 () {54 vars in 962 bytes} [Fri Jul 29 11:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:38:58.957055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdbe9-ee88-475e-8036-40aeecc01aea None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:58.957673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdbe9-ee88-475e-8036-40aeecc01aea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:58.958075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdbe9-ee88-475e-8036-40aeecc01aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:59.036810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5adbdbe9-ee88-475e-8036-40aeecc01aea None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:38:59.038167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5adbdbe9-ee88-475e-8036-40aeecc01aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:59.169553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 683/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Jul 29 11:38:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:38:59.181431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:38:59.183072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:59.349546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd52be-a950-4c4f-9156-0c0bc46bcecf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:38:59.370367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:59.468699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:38:59.469319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:38:59.469622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:38:59.469894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:38:59.472241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:38:59.567383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:38:59.569010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a904e-63a6-4c6c-95ac-5caa5bba46ed service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:38:59.588130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 685/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:00.549910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a53b5-de56-49c6-91d3-e43586b0815c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:00.550431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a53b5-de56-49c6-91d3-e43586b0815c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:00.550431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a53b5-de56-49c6-91d3-e43586b0815c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:00.551867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 684/1369] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:00.557016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1022e-6429-4782-8d1a-4896b19180f7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:00.557472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1022e-6429-4782-8d1a-4896b19180f7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:00.557735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1022e-6429-4782-8d1a-4896b19180f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:00.592194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:00.631660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-78e1022e-6429-4782-8d1a-4896b19180f7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:00.633397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78e1022e-6429-4782-8d1a-4896b19180f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:00.745790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 686/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:01.100293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:01.100679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:01.101054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:01.102834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 685/1371] 10.222.0.60 () {54 vars in 964 bytes} [Fri Jul 29 11:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:01.108044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476641-1fa9-46da-ae22-f73bdba22d4c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:01.108334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476641-1fa9-46da-ae22-f73bdba22d4c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:01.108606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476641-1fa9-46da-ae22-f73bdba22d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:01.198478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-48476641-1fa9-46da-ae22-f73bdba22d4c None None] MFA Rules not processed for user `939111fa56304aae981501d7a222b61f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:01.199727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-48476641-1fa9-46da-ae22-f73bdba22d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:01.249619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:01.284049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 687/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Jul 29 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:39:01.291725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:01.293210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:01.349363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:01.409802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4842-d8fa-4e9c-bf47-98009ccab978 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:01.488929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:01.489688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:01.490022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:01.490358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:01.492019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:01.599458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:01.616879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:01.618748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3988-ef88-41c4-b5cf-8e01b3901c88 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:01.644732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 686/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:01.670099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:01.670541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:01.670893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:01.674773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 688/1374] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:39:01.678787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b0c2-33d9-4585-b2cd-d6adbbf3ca3c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:01.679072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b0c2-33d9-4585-b2cd-d6adbbf3ca3c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:01.679406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b0c2-33d9-4585-b2cd-d6adbbf3ca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:01.745627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fdd5b0c2-33d9-4585-b2cd-d6adbbf3ca3c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:01.746833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fdd5b0c2-33d9-4585-b2cd-d6adbbf3ca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:01.862006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 687/1375] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:01.902060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:01.903975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:02.080968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0b3e-21f3-4f99-8616-d0ff7ceefd62 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:02.133803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:02.198009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:02.198642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:02.198924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:02.199196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:02.200831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:02.294481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:02.296097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b63d-b4ed-4bb7-80b6-9a99f3f3b4c7 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:02.315655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 689/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:04.368754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:04.369249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:04.369249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:04.370580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 688/1377] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:04.376713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb216-e595-4dc4-aebd-c6b906e1bdab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:04.377308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb216-e595-4dc4-aebd-c6b906e1bdab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:04.377589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb216-e595-4dc4-aebd-c6b906e1bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:04.448263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-96ddb216-e595-4dc4-aebd-c6b906e1bdab None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:04.449985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96ddb216-e595-4dc4-aebd-c6b906e1bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:04.459857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:04.554310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 690/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:04.599835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:04.601574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:04.669284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:04.757061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c21ef9-243f-4912-8a9d-6a0875216c2d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:04.871538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:04.872354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:04.872709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:04.873020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:04.874688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:04.895379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:04.971247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:04.972869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265daba6-845d-4b95-abe6-0d37d7502227 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:05.003645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 689/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:07.097247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:07.097843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:07.098144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:07.099761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 691/1380] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:07.105117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5da0d-3851-4f27-9678-8acc10ec9749 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:07.105589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5da0d-3851-4f27-9678-8acc10ec9749 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:07.106317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5da0d-3851-4f27-9678-8acc10ec9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:07.193137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6ff5da0d-3851-4f27-9678-8acc10ec9749 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:07.194343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ff5da0d-3851-4f27-9678-8acc10ec9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:07.301907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:07.309165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 690/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:07.353192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:07.354735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:07.509037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:07.523271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f84b0-1573-4838-be3c-5d4ba3bebf5a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:07.661378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:07.662026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:07.662321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:07.662596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:07.664181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:07.760007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:07.761678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ffd2-f114-4daa-8d4d-9fd8cf165d04 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:07.773246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:07.783253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 692/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:10.116308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:10.116913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:10.116913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:10.118360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 691/1383] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:10.125108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bb815-405a-4d5e-b421-657f75368079 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:10.125622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bb815-405a-4d5e-b421-657f75368079 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:10.126406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bb815-405a-4d5e-b421-657f75368079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:10.209255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bb2bb815-405a-4d5e-b421-657f75368079 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:10.210510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bb2bb815-405a-4d5e-b421-657f75368079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:10.313104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 693/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:10.357584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:10.359169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:10.519542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc35de3-b71a-4048-8210-04132a86c7e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:10.587119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:10.643116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:10.643805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:10.644147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:10.644490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:10.646852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:10.759396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:10.761483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc223829-8a6a-410d-98e6-eba031d2a060 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:10.786062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 692/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:13.398711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:13.399259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:13.399259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:13.400553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 694/1386] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:13.407368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6358b-212b-45eb-9b23-4bd1a97e34d5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:13.408058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6358b-212b-45eb-9b23-4bd1a97e34d5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:13.408058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6358b-212b-45eb-9b23-4bd1a97e34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:13.478671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d2b6358b-212b-45eb-9b23-4bd1a97e34d5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:13.479874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d2b6358b-212b-45eb-9b23-4bd1a97e34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:13.516834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:13.591025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 693/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:13.643636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:13.645605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:13.735773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:13.816694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb114e-af56-475e-9402-243fe06dfa5f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:13.948176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:13.949003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:13.949352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:13.949716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:13.951786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:14.000042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:14.057373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:14.059170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b352cac-bded-4bca-8fbf-16d0030206a1 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:14.078610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 695/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:16.193343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:16.193805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:16.194080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:16.195503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 694/1389] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:16.200593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa213-c714-4cca-a51a-5ffd03d994fa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:16.201027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa213-c714-4cca-a51a-5ffd03d994fa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:16.201147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa213-c714-4cca-a51a-5ffd03d994fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:16.267053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d52fa213-c714-4cca-a51a-5ffd03d994fa None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:16.268262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d52fa213-c714-4cca-a51a-5ffd03d994fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:16.368584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 696/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:16.413300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:16.414948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:16.563925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66b1e2-a970-4a2f-a005-f49b41e53119 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:16.580383 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:16.676479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:16.677129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:16.677406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:16.677724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:16.679369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:16.767655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:16.769257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7212ac-df19-40fa-b824-469582d9f086 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:16.787797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 695/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:16.793388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28fde-ed93-45fb-aa71-5733fd966282 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:16.794003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28fde-ed93-45fb-aa71-5733fd966282 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:16.794003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28fde-ed93-45fb-aa71-5733fd966282 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:16.795442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 697/1392] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:16.800973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540783b-8b05-4dc1-993b-a18d69a6e3e8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:16.801266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540783b-8b05-4dc1-993b-a18d69a6e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:16.801587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540783b-8b05-4dc1-993b-a18d69a6e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:16.827261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:16.876740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2540783b-8b05-4dc1-993b-a18d69a6e3e8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:16.878092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2540783b-8b05-4dc1-993b-a18d69a6e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:16.990367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 696/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:17.046709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:17.047063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:17.047370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:17.048899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 698/1394] 10.222.0.60 () {54 vars in 966 bytes} [Fri Jul 29 11:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:17.054028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3e13-d2ea-491a-8d62-ab6cf4ce0658 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:17.054393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3e13-d2ea-491a-8d62-ab6cf4ce0658 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:17.054758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3e13-d2ea-491a-8d62-ab6cf4ce0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:17.131630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-528c3e13-d2ea-491a-8d62-ab6cf4ce0658 None None] MFA Rules not processed for user `6bfc7686898b406bb89f9f0280308004`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:17.132745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-528c3e13-d2ea-491a-8d62-ab6cf4ce0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:17.174225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:17.213054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 697/1395] 10.222.0.60 () {58 vars in 1063 bytes} [Fri Jul 29 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:17.221345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:17.222909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:17.236425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:17.328091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6375c5e-e0a1-408b-b31d-7595252cf5f8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:17.402674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:17.403211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:17.403491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:17.403791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:17.405749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:17.482502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:17.526611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:17.528046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3804fe-5ca2-471a-94cb-6599eb7c54d3 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:17.546089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 699/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:18.300701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec50f1-84c1-402c-b458-c9bd61c563c8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.301213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec50f1-84c1-402c-b458-c9bd61c563c8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.301393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec50f1-84c1-402c-b458-c9bd61c563c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.368896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d5ec50f1-84c1-402c-b458-c9bd61c563c8 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:18.370132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d5ec50f1-84c1-402c-b458-c9bd61c563c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:18.456667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 698/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:18.503591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.504079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.504314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.505765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 700/1398] 10.222.0.60 () {54 vars in 943 bytes} [Fri Jul 29 11:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:18.512301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93cb82-6cbe-42cd-bba3-b84ebdef8a71 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.512658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93cb82-6cbe-42cd-bba3-b84ebdef8a71 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.513018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93cb82-6cbe-42cd-bba3-b84ebdef8a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.583980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:18.591554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fc93cb82-6cbe-42cd-bba3-b84ebdef8a71 None None] MFA Rules not processed for user `050cd624409b4c269af8805835ec5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:18.592759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fc93cb82-6cbe-42cd-bba3-b84ebdef8a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:18.705873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 699/1399] 10.222.0.60 () {58 vars in 1040 bytes} [Fri Jul 29 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:39:18.715429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:18.717016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:18.843872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbbde-080b-4561-a453-554a028ca0b6 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.844166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbbde-080b-4561-a453-554a028ca0b6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.845048 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbbde-080b-4561-a453-554a028ca0b6 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.846487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 700/1400] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:39:18.851377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.851657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.851936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.856648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258bebe-95cd-4f10-8d62-bb437a41c52c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:18.895950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:18.919122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:18.920622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:18.969353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:18.972156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:18.972431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:18.972710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:18.974412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:18.984156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:19.022804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 701/1401] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:39:19.060563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:19.062218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236d402-c6f8-497a-a688-fb0e62fcc095 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:19.067728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:19.069103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:19.071138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 701/1402] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:39:19.197332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26af57f-2e02-4228-84aa-438031cda709 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:19.285627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:19.332652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:19.333314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:19.333565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:19.333833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:19.335499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:19.431374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:19.432975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2724a-7938-438b-845a-7725206ffc56 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:19.453401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 702/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:39:21.550040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:21.550615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:21.550615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:21.555816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 702/1404] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:21.557465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b023-f215-403c-b789-8c244fa57756 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:21.557955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b023-f215-403c-b789-8c244fa57756 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:21.558069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b023-f215-403c-b789-8c244fa57756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:21.629140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ae74b023-f215-403c-b789-8c244fa57756 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:21.630509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ae74b023-f215-403c-b789-8c244fa57756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:21.673060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:21.740004 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 703/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:21.785365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:21.786971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:21.866735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:21.954819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9c10c-1bce-409e-ac10-02d8dcd207f5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:22.074451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:22.075078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:22.075358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:22.075635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:22.077272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:22.112691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:22.181560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:22.183409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e11dd-6e61-4986-ae26-cd5e004e79e1 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:22.206974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 703/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:24.290918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e295a-fb9d-493e-b006-a140df201752 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:24.291474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e295a-fb9d-493e-b006-a140df201752 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:24.291474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e295a-fb9d-493e-b006-a140df201752 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:24.292965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 704/1407] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:24.298662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aa50-46fb-4067-b8cc-37da69cebb53 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:24.299431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aa50-46fb-4067-b8cc-37da69cebb53 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:24.299713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aa50-46fb-4067-b8cc-37da69cebb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:24.370950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a642aa50-46fb-4067-b8cc-37da69cebb53 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:24.372177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a642aa50-46fb-4067-b8cc-37da69cebb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:24.582181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 704/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:24.628516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e295a-fb9d-493e-b006-a140df201752 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:24.630373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-253e295a-fb9d-493e-b006-a140df201752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:24.800683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e295a-fb9d-493e-b006-a140df201752 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:24.824280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:24.931718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:24.932340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:24.932622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:24.932894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:24.934562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:25.033584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:25.035234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4cf6b-4364-428d-916b-1d6c68048c7f service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:25.055739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 705/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:34.580330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:35.053274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:41.222946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d6f4-8d6b-4095-a4e4-a711cf3f46b0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:41.223484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d6f4-8d6b-4095-a4e4-a711cf3f46b0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:41.223581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d6f4-8d6b-4095-a4e4-a711cf3f46b0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:41.224937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 705/1410] 10.222.0.60 () {54 vars in 918 bytes} [Fri Jul 29 11:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:41.230140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f53-1930-43ad-8ca1-e8dedec4766f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:41.230526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f53-1930-43ad-8ca1-e8dedec4766f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:41.230691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e171f53-1930-43ad-8ca1-e8dedec4766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:41.305490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0e171f53-1930-43ad-8ca1-e8dedec4766f None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:41.306702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0e171f53-1930-43ad-8ca1-e8dedec4766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:41.412410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 706/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Jul 29 11:39:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:41.426751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb64f-ca9e-4e7a-ba69-4d9393ed1a96 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:41.427040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb64f-ca9e-4e7a-ba69-4d9393ed1a96 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:41.427317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb64f-ca9e-4e7a-ba69-4d9393ed1a96 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:41.428657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 706/1412] 10.222.0.60 () {54 vars in 918 bytes} [Fri Jul 29 11:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:41.433436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37684cd-834a-459e-853b-ab671caa777c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:41.433735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37684cd-834a-459e-853b-ab671caa777c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:41.434010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37684cd-834a-459e-853b-ab671caa777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:41.505889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:41.508955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f37684cd-834a-459e-853b-ab671caa777c None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:41.510733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f37684cd-834a-459e-853b-ab671caa777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:41.624247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 707/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Jul 29 11:39:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:44.098769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:44.099322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:44.099322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:44.100577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:44.105815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10cd9-d44e-4fed-b28b-04db469f0ee8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:44.106204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10cd9-d44e-4fed-b28b-04db469f0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:44.106373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10cd9-d44e-4fed-b28b-04db469f0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:44.173913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-49b10cd9-d44e-4fed-b28b-04db469f0ee8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:44.175128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-49b10cd9-d44e-4fed-b28b-04db469f0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:44.229511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:44.271347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:44.315070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:44.316666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:44.466817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbf253-4ce4-4efb-a766-7f1265d3d817 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:44.540201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:44.580492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:44.581107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:44.581384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:44.581686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:44.583289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:44.673406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:44.674964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadefc8f-1ca0-4de0-9d35-cc0d14a3ab50 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:44.693208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 708/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:45.607285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:45.607834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:45.607834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:45.609201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:45.614314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ffc7-6886-4fda-bd26-70a170f0226a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:45.614763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ffc7-6886-4fda-bd26-70a170f0226a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:45.614861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ffc7-6886-4fda-bd26-70a170f0226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:45.690018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3ca3ffc7-6886-4fda-bd26-70a170f0226a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:45.691219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ca3ffc7-6886-4fda-bd26-70a170f0226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:45.718698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:45.787780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:45.937607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:45.939138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:46.083454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49652588-7e5f-4393-a755-3c9b8cbb343a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:46.123620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:46.197279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:46.197934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:46.198216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:46.198489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:46.200106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:46.289843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:46.291437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f30c1-883e-461d-a3ff-fb96b4716c7a service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:46.309587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 710/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:47.205188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:47.205688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:47.205803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:47.207172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:39:47.212327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cb82-1d3b-4a2e-912c-78b0110ea5f4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:47.212745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cb82-1d3b-4a2e-912c-78b0110ea5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:47.212854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059cb82-1d3b-4a2e-912c-78b0110ea5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:47.268111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:47.289661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0059cb82-1d3b-4a2e-912c-78b0110ea5f4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:47.290873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0059cb82-1d3b-4a2e-912c-78b0110ea5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:47.385401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:47.539115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:47.540575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:47.685609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f09c-4eb9-43a0-915a-c76ac6d05683 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:47.698052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:47.798801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:47.799338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:47.799616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:47.799885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:47.801526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:47.890913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:47.892507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73671f-85a1-468e-9e90-6e13ae0ae655 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:47.910650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 711/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:48.783907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:48.784482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:48.784482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:48.785834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:48.790817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc78-7e6a-4e9f-a2f5-6515f557b4af None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:48.791245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc78-7e6a-4e9f-a2f5-6515f557b4af None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:48.791367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc78-7e6a-4e9f-a2f5-6515f557b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:48.811315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:48.867015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-af83dc78-7e6a-4e9f-a2f5-6515f557b4af None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:48.868121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-af83dc78-7e6a-4e9f-a2f5-6515f557b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:48.963266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:39:49.114633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:49.116145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:49.224969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:49.263070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b775-2f2f-453e-afb2-780724867d45 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:49.373871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:49.374519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:49.374799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:49.375072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:49.376681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:49.450586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:49.464771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:49.466385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb6b76-fa66-4d96-aa23-4cceefa578ea service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:49.484944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 713/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:50.345810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:50.346454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:50.346454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:50.347730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:50.352613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0986d-1603-47a8-94d4-59ca7c7c8e71 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:50.353161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0986d-1603-47a8-94d4-59ca7c7c8e71 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:50.353470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0986d-1603-47a8-94d4-59ca7c7c8e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:50.430650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-03e0986d-1603-47a8-94d4-59ca7c7c8e71 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:50.431861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-03e0986d-1603-47a8-94d4-59ca7c7c8e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:50.525882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:50.677014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:50.678603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:50.761130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:50.823664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb401a-af18-4d53-818b-f2344badeccd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:50.936100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:50.936718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:50.937004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:50.937271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:50.938920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:50.987834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:51.029097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:51.031319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a949-7b22-4710-92a7-9d4e1fc3a0c6 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:51.049164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 714/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:51.868828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:51.869461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:51.869461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:51.870949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:51.877274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b25b-783b-49e5-a6f6-a50650c52f22 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:51.877742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b25b-783b-49e5-a6f6-a50650c52f22 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:51.877867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b25b-783b-49e5-a6f6-a50650c52f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:51.954330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d138b25b-783b-49e5-a6f6-a50650c52f22 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:51.955543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d138b25b-783b-49e5-a6f6-a50650c52f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:52.051319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:52.203723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:52.205270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:52.254155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:52.350895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634d39-f995-47a0-a361-1c854f62feb0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:52.463345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:52.463882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:52.464163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:52.464438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:52.466095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:52.472939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:52.556653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:52.558291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f8e1-f131-48c5-a43c-904af05824fe service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:52.576679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 716/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:53.382670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:53.383158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:53.383262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:53.384645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:53.389652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100007f1-8e92-4d5b-9142-ff82a72ff9d3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:53.390290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100007f1-8e92-4d5b-9142-ff82a72ff9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:53.390290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100007f1-8e92-4d5b-9142-ff82a72ff9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:53.465738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-100007f1-8e92-4d5b-9142-ff82a72ff9d3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:53.466851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-100007f1-8e92-4d5b-9142-ff82a72ff9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:53.534439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:53.563736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:53.713141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:53.714676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:53.732143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:53.860388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57790d-2c0b-43da-8721-f792a9bcc057 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:53.947883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:53.973907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:53.974521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:53.974797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:53.975065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:53.976683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:54.193487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:54.195134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4171bd-6385-436a-b5cc-9c289c3761f8 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:54.213760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 717/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:55.021444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:55.022012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:55.022012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:55.023360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:55.028273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7221a-67aa-495c-b985-193d94ec0246 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:55.028731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7221a-67aa-495c-b985-193d94ec0246 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:55.028862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7221a-67aa-495c-b985-193d94ec0246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:55.103603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dbd7221a-67aa-495c-b985-193d94ec0246 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:55.104803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dbd7221a-67aa-495c-b985-193d94ec0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:55.146988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:55.202678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:55.357459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:55.359696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:55.502625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5718d-9743-4859-9007-3355be00fc8c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:55.556041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:55.613998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:55.614541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:55.614817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:55.615083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:55.616690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:55.704433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:55.705831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ca339-d9a8-40cc-bf88-821792ba4701 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:55.725126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 719/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:56.528857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:56.529381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:56.529381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:56.531210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:56.536052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041b79-829f-4511-84a0-90568baa1ea5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:56.536494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041b79-829f-4511-84a0-90568baa1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:56.536615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041b79-829f-4511-84a0-90568baa1ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:56.730993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-04041b79-829f-4511-84a0-90568baa1ea5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:56.732198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-04041b79-829f-4511-84a0-90568baa1ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:56.734799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:56.828942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:56.979939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:56.981462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:57.125868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41c811-7a43-4c98-9ec9-9b1aa6fe5270 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:57.152732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:57.238643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:57.239285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:57.239560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:57.239826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:57.241442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:57.328606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:57.330206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d2965-fd7d-44e4-8245-990cf93cdfa6 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:57.356467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 720/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:59.272219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:59.272784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:59.272784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:59.274147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:39:59.279377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1539-dbc9-4801-8645-935557f14da3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:59.279786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1539-dbc9-4801-8645-935557f14da3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:59.279930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1539-dbc9-4801-8645-935557f14da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:59.320381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:59.347860 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-48cf1539-dbc9-4801-8645-935557f14da3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:39:59.349067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-48cf1539-dbc9-4801-8645-935557f14da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:59.446047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:39:59.484926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:39:59.486472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:59.587433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88a42d-ee36-4c54-a4b1-9233fc76e733 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:39:59.617886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:59.659448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:39:59.660060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:39:59.660338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:39:59.660610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:39:59.662239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:39:59.769421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:39:59.770880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca021d-8732-43de-b163-c423fdb15b2c service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:39:59.788834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 722/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:01.958452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:01.959024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:01.959024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:01.960334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:01.965597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be77343-9bcf-4b10-ac16-69af80bf38cd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:01.966021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be77343-9bcf-4b10-ac16-69af80bf38cd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:01.966135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be77343-9bcf-4b10-ac16-69af80bf38cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:02.031258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0be77343-9bcf-4b10-ac16-69af80bf38cd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:02.032467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0be77343-9bcf-4b10-ac16-69af80bf38cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:02.044902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:02.129809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:02.167634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:02.169177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:02.270175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0db8ab-3073-428a-9658-22e5ee54485c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:02.282156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:02.343897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:02.344517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:02.344799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:02.345079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:02.346730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:02.456479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:02.457961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65af00-44fa-4216-a3a9-a4a6118f33fa service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:02.476396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 723/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:04.819234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:04.819799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:04.819799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:04.821118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:04.826491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c9d7-b828-4e81-9b1f-560ec28279a8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:04.827497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c9d7-b828-4e81-9b1f-560ec28279a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:04.827721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c9d7-b828-4e81-9b1f-560ec28279a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:04.875812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:04.894639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a0c9c9d7-b828-4e81-9b1f-560ec28279a8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:04.895852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a0c9c9d7-b828-4e81-9b1f-560ec28279a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:04.990144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:05.029717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:05.031365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:05.133299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5684732-b172-4024-b8b8-5fb1404c63ae None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:05.172539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:05.207196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:05.207816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:05.208095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:05.208366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:05.210014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:05.318648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:05.320095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ece107-4b4d-4ffc-b650-4377892083bd service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:05.338461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 725/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:40:07.481071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:07.481650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:07.481650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:07.483518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:07.488805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef65c8-b1cc-4638-941f-0967dc47ac94 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:07.489195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef65c8-b1cc-4638-941f-0967dc47ac94 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:07.489358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef65c8-b1cc-4638-941f-0967dc47ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:07.558186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-52ef65c8-b1cc-4638-941f-0967dc47ac94 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:07.559408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-52ef65c8-b1cc-4638-941f-0967dc47ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:07.579924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:07.659290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:07.699083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:07.700637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:07.803223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a48b5-6ae7-4bcb-850c-1191d8fe8a3e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:07.822909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:07.877925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:07.878553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:07.878838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:07.879117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:07.880744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:07.987870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:07.989310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087391-e884-4b39-832a-a25599f06a7d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:08.007510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 726/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:10.178694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:10.179277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:10.179277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:10.180589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:10.186379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207d3a-30d6-4fb1-991b-f7bf7b38e73b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:10.186832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207d3a-30d6-4fb1-991b-f7bf7b38e73b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:10.186931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207d3a-30d6-4fb1-991b-f7bf7b38e73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:10.251268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:10.254011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-42207d3a-30d6-4fb1-991b-f7bf7b38e73b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:10.255868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-42207d3a-30d6-4fb1-991b-f7bf7b38e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:10.352217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:10.391417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:10.393023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:10.495231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec5c86-36e6-45ac-a863-16f4f5836524 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:10.543165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:10.568117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:10.568733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:10.569011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:10.569282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:10.570928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:10.678241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:10.679668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1028-7c2d-4c5e-9fdb-cea661a38400 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:10.697195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 728/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:12.910204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:12.910737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:12.910737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:12.912088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:12.917180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637d90-59b1-438e-9d11-31892fd98178 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:12.917616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637d90-59b1-438e-9d11-31892fd98178 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:12.917761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637d90-59b1-438e-9d11-31892fd98178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:12.983748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3a637d90-59b1-438e-9d11-31892fd98178 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:12.984953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3a637d90-59b1-438e-9d11-31892fd98178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:13.014385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:13.082880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:13.120644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:13.122215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:13.225792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39252678-d20a-48e5-bbb6-3027e7bea99b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:13.254697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:13.300549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:13.301165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:13.301471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:13.301751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:13.303374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:13.412593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:13.414080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b446538-fe49-4de8-bb92-161b05d4eea5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:13.432572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 729/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:15.511738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:15.512188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:15.512284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:15.513642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:15.519886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed146-fe8e-4482-8353-80a70920893b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:15.520339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed146-fe8e-4482-8353-80a70920893b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:15.520532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed146-fe8e-4482-8353-80a70920893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:15.593724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-151ed146-fe8e-4482-8353-80a70920893b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:15.594939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-151ed146-fe8e-4482-8353-80a70920893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:15.603383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:15.694278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:40:15.733124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:15.734657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:15.835169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bb439-00c5-42df-89b0-d410351fb341 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:15.890010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:15.908114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:15.908732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:15.909013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:15.909286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:15.910952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:16.017597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:16.019029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df247c-5627-43c8-beaf-c36cf73b2c8d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:16.036625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 731/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:18.103419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:18.103983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:18.103983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:18.105357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:18.115492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3dde-777d-4226-8c76-b41f7ab8eaa7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:18.115929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3dde-777d-4226-8c76-b41f7ab8eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:18.116027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3dde-777d-4226-8c76-b41f7ab8eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:18.187027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d11b3dde-777d-4226-8c76-b41f7ab8eaa7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:18.188248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d11b3dde-777d-4226-8c76-b41f7ab8eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:18.226324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:18.284187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:18.321975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:18.323497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:18.427384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25f72-fb24-414b-9520-96481a8fe3dd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:18.464965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:18.500577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:18.501196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:18.501506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:18.501785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:18.503406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:18.609629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:18.611041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f8a0c-5fcf-456e-bf22-910669382160 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:18.629181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 732/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:20.645474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:20.645950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:20.646049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:20.647417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:20.652692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f72b3-fe88-4ff3-b96f-e2311dc73cd8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:20.653121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f72b3-fe88-4ff3-b96f-e2311dc73cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:20.653271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f72b3-fe88-4ff3-b96f-e2311dc73cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:20.719336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-676f72b3-fe88-4ff3-b96f-e2311dc73cd8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:20.720544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-676f72b3-fe88-4ff3-b96f-e2311dc73cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:20.738210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:20.817215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:20.853080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:20.854651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:20.958884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cdf3a-b864-4f6f-9582-a77453026d8a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:21.027700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:21.035089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:21.035701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:21.035977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:21.036247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:21.037879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:21.146439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:21.147889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6fa74-6d37-4096-b46f-bf3e3648e7ec service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:21.165670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 734/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:23.194242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:23.194715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:23.194821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:23.196138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:23.201711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea318f-36aa-4369-93ca-663280177c9e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:23.202117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea318f-36aa-4369-93ca-663280177c9e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:23.202266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea318f-36aa-4369-93ca-663280177c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:23.268520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a9ea318f-36aa-4369-93ca-663280177c9e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:23.269748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a9ea318f-36aa-4369-93ca-663280177c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:23.317110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:23.365556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:23.403588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:23.405343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:23.508816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec951b-0a2a-4abc-9766-2fe454bacb26 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:23.557276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:23.583640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:23.584246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:23.584522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:23.584791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:23.586410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:23.692841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:23.694451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a862d-70db-40f9-adb6-19e43241a004 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:23.712920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 735/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:40:33.363673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=22 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:33.710567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=66 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:43.359126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970463-5f26-4502-9020-eaf16e904790 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:43.359650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970463-5f26-4502-9020-eaf16e904790 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:43.359650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970463-5f26-4502-9020-eaf16e904790 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:43.360947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 736/1471] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:43.366104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e3a8-453e-4b21-a22f-98181b7216e3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:43.366642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e3a8-453e-4b21-a22f-98181b7216e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:43.366642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e3a8-453e-4b21-a22f-98181b7216e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:43.432611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e495e3a8-453e-4b21-a22f-98181b7216e3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:43.433852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e495e3a8-453e-4b21-a22f-98181b7216e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:43.531615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 736/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:43.613305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:43.613565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:43.613836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:43.615142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 737/1473] 10.222.0.60 () {54 vars in 966 bytes} [Fri Jul 29 11:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:43.619863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2aeb-4c3a-425c-9249-4608953c4aa5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:43.620156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2aeb-4c3a-425c-9249-4608953c4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:43.620435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2aeb-4c3a-425c-9249-4608953c4aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:43.696888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-48ed2aeb-4c3a-425c-9249-4608953c4aa5 None None] MFA Rules not processed for user `6bfc7686898b406bb89f9f0280308004`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:43.698108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-48ed2aeb-4c3a-425c-9249-4608953c4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:43.718759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:43.774486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 737/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Fri Jul 29 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:43.782909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:43.784515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:43.886572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b3fb-16c5-4578-a74e-b6bae9f80241 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:43.959940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:43.960556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:43.960835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:43.961107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:43.962751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:44.016384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:44.071376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:44.072811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022d705-6fee-4f13-98f5-31aa903e73d3 service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:44.091031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 738/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:46.204799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:46.205289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:46.205395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:46.207003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 738/1476] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:46.212337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac23a1-88f0-4eaa-a096-805472f85343 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:46.212757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac23a1-88f0-4eaa-a096-805472f85343 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:46.212890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac23a1-88f0-4eaa-a096-805472f85343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:46.279194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b2ac23a1-88f0-4eaa-a096-805472f85343 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:46.280387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b2ac23a1-88f0-4eaa-a096-805472f85343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:46.373237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 739/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:46.396251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:46.397825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:46.523862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e80f9-a47e-414b-be22-4f68878a78ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:46.572509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:46.617361 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:46.618002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:46.618276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:46.618540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:46.619215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:46.620932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:40:46.620932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:40:46.620932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:40:46.622705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69600c87-ea73-4205-80c6-a2b208504f18 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:46.642038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 739/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Jul 29 11:40:46 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:40:48.671589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:48.672101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:48.672180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:48.673575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 740/1479] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 11:40:48.678853 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bad-00e7-4440-932c-4355df21941a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:48.679262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bad-00e7-4440-932c-4355df21941a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:48.679415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bad-00e7-4440-932c-4355df21941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:48.745160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e1e4bad-00e7-4440-932c-4355df21941a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:48.746404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e1e4bad-00e7-4440-932c-4355df21941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:48.842951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 740/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:48.886257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:48.887873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:48.897897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:49.040056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c82222-7630-43cd-95f0-eb09e127017c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:49.119107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:49.151291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:49.151842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:49.152118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:49.152388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:49.154656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:49.245064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:49.246718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6924b-d7b7-4ac8-8464-8b9358bcec5b service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:49.271357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 741/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:51.444046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:51.444604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:51.444604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:51.445919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 741/1482] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:51.451465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7191-50b0-4bc9-b332-4941651944bb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:51.451905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7191-50b0-4bc9-b332-4941651944bb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:51.452010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7191-50b0-4bc9-b332-4941651944bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:51.517938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-083f7191-50b0-4bc9-b332-4941651944bb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:51.519145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-083f7191-50b0-4bc9-b332-4941651944bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:51.564388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:51.614627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 742/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:51.650962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:51.652491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:51.677362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:51.759641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93659d43-aa9a-4674-afb8-06385d5c60e9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:51.833062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:51.833717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:51.834000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:51.834274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:51.835887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:51.909437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:51.944051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:51.945501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222960-b5c0-4541-bebe-741757006f63 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:51.963815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 742/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:54.014543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:54.015384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:54.015491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:54.016890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 743/1485] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:54.022162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1320-44db-4ab0-9820-f6391f47f8ef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:54.022604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1320-44db-4ab0-9820-f6391f47f8ef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:54.022706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1320-44db-4ab0-9820-f6391f47f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:54.087629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fe8e1320-44db-4ab0-9820-f6391f47f8ef None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:54.088823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fe8e1320-44db-4ab0-9820-f6391f47f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:54.187670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 743/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:54.225929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:54.227451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:54.333828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec3ef-921c-4a5b-b743-ebcdda5aab66 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:54.411618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:54.413919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:54.414555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:54.415113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:54.415770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:54.417498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:54.528593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:54.530089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391ab3b-f40e-4424-990f-28816726bd63 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:54.548278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 744/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:56.639351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:56.640128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:56.640128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:56.641459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 744/1488] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:56.646593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c233-a47e-45c4-a792-ff99c2c8be14 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:56.647049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c233-a47e-45c4-a792-ff99c2c8be14 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:56.647161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c233-a47e-45c4-a792-ff99c2c8be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:56.711852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-16b6c233-a47e-45c4-a792-ff99c2c8be14 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:56.713046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-16b6c233-a47e-45c4-a792-ff99c2c8be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:56.765162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:56.808672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 745/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:40:56.848916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:56.850547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:56.885950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:56.954800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ce0a7-3baf-44a9-8d83-a3060aa4d14a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:57.028958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:57.029617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:57.029901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:57.030171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:57.031782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:57.111965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:57.141984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:57.143409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a967-2b8e-4345-9259-4bfcdb829215 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:57.161157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 745/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:40:59.447671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:59.448230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:59.448230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:59.449604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 746/1491] 10.222.0.60 () {54 vars in 926 bytes} [Fri Jul 29 11:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:40:59.454898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cbc3-52c2-44da-bb55-85fb0b006e9b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:59.455328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cbc3-52c2-44da-bb55-85fb0b006e9b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:59.455436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cbc3-52c2-44da-bb55-85fb0b006e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:59.521249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3758cbc3-52c2-44da-bb55-85fb0b006e9b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:40:59.522535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3758cbc3-52c2-44da-bb55-85fb0b006e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:59.619254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 746/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Fri Jul 29 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:40:59.658500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:40:59.660062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:59.763564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56051b-e69c-4596-a8d7-b792ab93a913 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:40:59.835835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:40:59.836456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:40:59.836741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:40:59.837016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:40:59.838678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:40:59.848670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:59.947557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:40:59.949556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f352f0-b045-44f1-868b-29d4e327586d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:40:59.967769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 747/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:41:09.617500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=82 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:41:09.965247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=50 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:34.329237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:34.329864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:34.329864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:34.405104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:42:34.406335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:34.504974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 747/1494] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:42:34.514120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:34.514659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:34.514762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:34.589754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:42:34.590937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:34.686243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 748/1495] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:42:34.691052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:34.692261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:34.704282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a97ed-1c6b-4a4e-842a-27cdb9be51ad None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:34.765361 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:34.798264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:34.798877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:34.799152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:34.799423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:34.800128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:42:34.800426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:34.801472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:34.801472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:42:34.801472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:42:34.802348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:34.813858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 748/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:42:34.823262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:34.832533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521725c-4d5c-4d64-9734-7cdef8d290a6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:34.894300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:34.927561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:34.928201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:34.928474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:34.928743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:34.929957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:34.931694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:34.931694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:42:34.931694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:42:34.932863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:34.988415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 749/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:42:34 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:42:34.993242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:34.994908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:35.028780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6769-8ecc-42c1-bfdc-123e025c4474 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:35.126034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:35.126657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.126935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.127203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.127853 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:35.128856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:35.128856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:42:35.128856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:42:35.130224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:35.176281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 749/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:42:34 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:42:35.180826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:35.182410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:35.248656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475db75-81c0-42e5-ad78-98758bbee270 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:35.340176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:35.352812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:35.353583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.353804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.354072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.354917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:35.355934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:35.355934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:42:35.355934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:42:35.356825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:35.369954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 750/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:42:35.374251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:35.375776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:35.387902 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a53ccc-b9e4-46e1-a913-cefd2f3f73cf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:35.413216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:35.483495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:35.484115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.484400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.484672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.485354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:35.486377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:35.486377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:42:35.486377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:42:35.487258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f4e2-5d10-4474-a724-18de5301b9d0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:35.500059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 750/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:42:35.504267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:35.505834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:35.541725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93182-2b23-46b3-8543-cc553d5fbec0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:35.635702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:35.636290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.636568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.636843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] PATH_INFO: `/v3/projects/672b8b05398c4d82ac74df78e937e9ef/users/fe2d1256991a4581acc7df381ef42032/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.658985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=672b8b05398c4d82ac74df78e937e9ef, user_id=fe2d1256991a4581acc7df381ef42032, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:35.660016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:35.660016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:42:35.660016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:42:35.662032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185afcc-3576-4e83-bf6d-100adb6b5b9b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:35.687131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 751/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:42:35 2022] PUT /identity/v3/projects/672b8b05398c4d82ac74df78e937e9ef/users/fe2d1256991a4581acc7df381ef42032/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:42:35.699508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ce2f-575e-45fa-81f5-170163f31c3c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.699805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ce2f-575e-45fa-81f5-170163f31c3c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.700089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ce2f-575e-45fa-81f5-170163f31c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.756754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ea14ce2f-575e-45fa-81f5-170163f31c3c None None] MFA Rules not processed for user `fe2d1256991a4581acc7df381ef42032`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:42:35.758733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea14ce2f-575e-45fa-81f5-170163f31c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:35.837614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 751/1502] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:42:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:42:35.850470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.850888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.851228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.852662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 752/1503] 10.222.0.60 () {54 vars in 964 bytes} [Fri Jul 29 11:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:42:35.857494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b698-0991-4ed5-aba1-8842bcab3807 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:35.857802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b698-0991-4ed5-aba1-8842bcab3807 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:35.858057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b698-0991-4ed5-aba1-8842bcab3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:35.889607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:35.932918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f5f4b698-0991-4ed5-aba1-8842bcab3807 None None] MFA Rules not processed for user `939111fa56304aae981501d7a222b61f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:42:35.934127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f5f4b698-0991-4ed5-aba1-8842bcab3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.008784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 752/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Jul 29 11:42:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:42:36.016905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:36.018429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.067794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:36.121697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b976c7-8162-407e-ae63-a57763dd81c0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:36.193902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:36.194663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:36.194949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:36.195307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:36.196908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.292967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:36.294427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:36.297843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:36.313295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 753/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:42:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:42:36.357815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54962bb3-2cb8-4699-a774-4f716cc73e89 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:36.358108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54962bb3-2cb8-4699-a774-4f716cc73e89 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:36.358385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54962bb3-2cb8-4699-a774-4f716cc73e89 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:36.359734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 753/1506] 10.222.0.60 () {52 vars in 830 bytes} [Fri Jul 29 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:42:36.363185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:36.364419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.462963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830035-8a34-4bb4-bd9b-ccdca8ddf166 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:36.558070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:36.558764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:36.558975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:36.559247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] PATH_INFO: `/v3/users/fe2d1256991a4581acc7df381ef42032` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:36.571271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2d1256991a4581acc7df381ef42032)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:36.572296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:36.572296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:42:36.572296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:42:36.573527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:36.582883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:36.636082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2d1256991a4581acc7df381ef42032'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:36.636615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2d1256991a4581acc7df381ef42032'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:36.646189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2d1256991a4581acc7df381ef42032'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:36.646619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2d1256991a4581acc7df381ef42032'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:36.664735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2d1256991a4581acc7df381ef42032'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:36.682743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 754/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:42:36 2022] DELETE /identity/v3/users/fe2d1256991a4581acc7df381ef42032 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:42:36.687205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:36.687657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:36.687765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:36.744312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:42:36.745474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.819392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:36.832387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 754/1508] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:42:36.842567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:36.843778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:36.942053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43a76-c5b6-4bf7-9978-36c36fa3f4f3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:36.995597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:37.016718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:37.017349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:37.017661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:37.017940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:37.019548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:37.128359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:37.129832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c554d9-9fec-4462-b15f-9643e44e7feb service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:37.148834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 755/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:42:37.505835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:42:37.507365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:42:37.519699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2897f-9378-4ab2-a05a-ed06afe9b0f9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:42:37.619801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:42:37.620451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:42:37.620733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:42:37.621005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] PATH_INFO: `/v3/projects/672b8b05398c4d82ac74df78e937e9ef` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:42:37.631034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] RBAC: Authorizing `identity:delete_project(project_id=672b8b05398c4d82ac74df78e937e9ef)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:42:37.632103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:42:37.632103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:42:37.632103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:42:37.633302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:42:37.695513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672b8b05398c4d82ac74df78e937e9ef', 'request_id': 'req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:37.708513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672b8b05398c4d82ac74df78e937e9ef', 'request_id': 'req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:37.715135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672b8b05398c4d82ac74df78e937e9ef', 'request_id': 'req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:37.741282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] The token cache is being invalidate because project 672b8b05398c4d82ac74df78e937e9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:42:37.741667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:37.742101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef3ecf5d-1ee9-4bb3-8957-f37fb9fe800b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:42:37.743512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 755/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:42:37 2022] DELETE /identity/v3/projects/672b8b05398c4d82ac74df78e937e9ef => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:42:47.145929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=62 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:42:47.739313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:18.307893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:18.308486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:18.308486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:18.309812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:18.314678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed07fb-edb0-4fe8-bafd-249ae851f5d1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:18.315134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed07fb-edb0-4fe8-bafd-249ae851f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:18.315409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed07fb-edb0-4fe8-bafd-249ae851f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:18.396332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-10ed07fb-edb0-4fe8-bafd-249ae851f5d1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:18.397544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10ed07fb-edb0-4fe8-bafd-249ae851f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:18.502031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:18.657274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:18.659443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:18.780945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b047f8-ee4a-452c-9d68-3e9c24889b52 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:18.787063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:18.787672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:18.787950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:18.788223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:18.796159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:18.797787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108d10-3290-4e98-b7b9-a30593deb899 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:18.807330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 757/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:19.647895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d565676-51c7-4c9d-bdcb-510e3552ffc5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:19.648420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d565676-51c7-4c9d-bdcb-510e3552ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:19.648420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d565676-51c7-4c9d-bdcb-510e3552ffc5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:19.649764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:19.654488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f25d-e192-4a90-9e2a-8ac161868aac None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:19.654934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f25d-e192-4a90-9e2a-8ac161868aac None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:19.655032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f25d-e192-4a90-9e2a-8ac161868aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:19.674763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4ed0f25d-e192-4a90-9e2a-8ac161868aac None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:19.675952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4ed0f25d-e192-4a90-9e2a-8ac161868aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:19.683766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:19.835115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d565676-51c7-4c9d-bdcb-510e3552ffc5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:19.849985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d565676-51c7-4c9d-bdcb-510e3552ffc5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:19.855359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:19.855969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:19.856252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:19.856523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:19.864747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:19.866353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b48f9c-1927-4db9-907d-6c8a21cb3eda service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:19.875546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 758/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:20.505668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3893-a2e4-4f0f-bd65-33b769124e4b None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:20.505901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3893-a2e4-4f0f-bd65-33b769124e4b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:20.506180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3893-a2e4-4f0f-bd65-33b769124e4b None None] PATH_INFO: `/v3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:20.507531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 759/1517] 10.222.0.58 () {54 vars in 925 bytes} [Fri Jul 29 11:44:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:44:20.514325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7359ed-8fd1-4549-8025-a5f569ac74f2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:20.514623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7359ed-8fd1-4549-8025-a5f569ac74f2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:20.514901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7359ed-8fd1-4549-8025-a5f569ac74f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:20.573685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5e7359ed-8fd1-4549-8025-a5f569ac74f2 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:20.574880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e7359ed-8fd1-4549-8025-a5f569ac74f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:20.591301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:20.647095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 759/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 29 11:44:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:24.581548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66e8e-067b-4f58-bf24-875df4b6685a None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:24.582086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66e8e-067b-4f58-bf24-875df4b6685a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:24.582086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66e8e-067b-4f58-bf24-875df4b6685a None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:24.583378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 760/1519] 10.222.0.60 () {54 vars in 961 bytes} [Fri Jul 29 11:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:24.588581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c014883-128f-475e-9318-d14bf9345729 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:24.588994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c014883-128f-475e-9318-d14bf9345729 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:24.589131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c014883-128f-475e-9318-d14bf9345729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:24.609243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5c014883-128f-475e-9318-d14bf9345729 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:24.610471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5c014883-128f-475e-9318-d14bf9345729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:24.619801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 760/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Jul 29 11:44:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:24.627688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66e8e-067b-4f58-bf24-875df4b6685a None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:24.641390 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66e8e-067b-4f58-bf24-875df4b6685a None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:24.647287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:24.647901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:24.648189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:24.648469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:24.657303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:24.658942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7aa7-0824-4b1a-ae37-961fe10c22c2 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:24.668490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 761/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:31.102164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87adfda-ad00-46a0-b535-0d20719145f3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:31.102777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87adfda-ad00-46a0-b535-0d20719145f3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:31.102777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87adfda-ad00-46a0-b535-0d20719145f3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:31.104086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:31.108775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722e12-0fd3-4e5c-9e47-d72f5902a29b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:31.109182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722e12-0fd3-4e5c-9e47-d72f5902a29b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:31.109329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722e12-0fd3-4e5c-9e47-d72f5902a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:31.129277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6d722e12-0fd3-4e5c-9e47-d72f5902a29b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:31.130471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6d722e12-0fd3-4e5c-9e47-d72f5902a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:31.138422 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:44:31.288886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87adfda-ad00-46a0-b535-0d20719145f3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:31.304434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87adfda-ad00-46a0-b535-0d20719145f3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:31.310211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:31.310832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:31.311115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:31.311390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:31.319697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:31.321271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef904a0-b519-4214-869e-0a749986e8f0 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:31.330734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 762/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:32.154255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc5ad-1eb0-4ada-8eb8-ed64eb7b3b76 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:32.154798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc5ad-1eb0-4ada-8eb8-ed64eb7b3b76 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:32.154798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc5ad-1eb0-4ada-8eb8-ed64eb7b3b76 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:32.156156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 11:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:32.161549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30844e-19a7-4b05-83e0-c8e5d0731545 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:32.161968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30844e-19a7-4b05-83e0-c8e5d0731545 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:32.162133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30844e-19a7-4b05-83e0-c8e5d0731545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:32.184044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2c30844e-19a7-4b05-83e0-c8e5d0731545 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:32.185247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c30844e-19a7-4b05-83e0-c8e5d0731545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:32.193511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 11:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:32.343338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efc5ad-1eb0-4ada-8eb8-ed64eb7b3b76 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:32.357921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efc5ad-1eb0-4ada-8eb8-ed64eb7b3b76 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:32.363884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:32.364492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:32.364773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:32.365047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:32.373028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:32.374673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1527333-71b8-4837-831b-2fd7d6235d07 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:32.383921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 764/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:36.242679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:36.243203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:36.243203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:36.244560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:36.249648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7c55-6818-4e91-b93b-02e2729ec440 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:36.250113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7c55-6818-4e91-b93b-02e2729ec440 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:36.250218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7c55-6818-4e91-b93b-02e2729ec440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:36.270065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bf9a7c55-6818-4e91-b93b-02e2729ec440 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:36.271262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf9a7c55-6818-4e91-b93b-02e2729ec440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:36.280584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:36.353030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:36.354742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:36.432200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef307-d45f-442e-92ae-45762e6b4e2c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:36.435788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:36.436405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:36.436689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:36.436964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:36.446611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:36.447969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111968e-2f1d-402b-825a-398e82b80f36 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:36.457409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 765/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:38.419544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de926-ec5d-4afd-a1fa-166b621bfa52 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:38.420118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de926-ec5d-4afd-a1fa-166b621bfa52 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:38.420118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de926-ec5d-4afd-a1fa-166b621bfa52 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:38.421449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:38.427111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d399-b5bb-4c0d-8abb-35f824eb802d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:38.427544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d399-b5bb-4c0d-8abb-35f824eb802d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:38.427656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d399-b5bb-4c0d-8abb-35f824eb802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:38.447626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-34f3d399-b5bb-4c0d-8abb-35f824eb802d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:38.448761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34f3d399-b5bb-4c0d-8abb-35f824eb802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:38.456774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:38.492712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775de926-ec5d-4afd-a1fa-166b621bfa52 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:38.504481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775de926-ec5d-4afd-a1fa-166b621bfa52 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:38.508475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:38.509128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:38.509485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:38.509806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:38.519397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:38.520837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37735016-f3bd-4def-8c0d-3280599d0296 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:38.530258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 767/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:41.905455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:41.906015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:41.906015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:41.907391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:41.912586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539a7-1c77-4546-88f4-4d8f1a93639a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:41.912991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539a7-1c77-4546-88f4-4d8f1a93639a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:41.913134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539a7-1c77-4546-88f4-4d8f1a93639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:41.932081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bb9539a7-1c77-4546-88f4-4d8f1a93639a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:41.933274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb9539a7-1c77-4546-88f4-4d8f1a93639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:41.941621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:42.242082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:42.243773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:42.308551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:42.322898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2bad3-4713-4861-9094-e96ad00ca98a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:42.326485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:42.327103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:42.327387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:42.327663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:42.337267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:42.338726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94861ef-1c42-4df7-aa92-01e1ed33137a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:42.348605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 768/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:44.352893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:44.353487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:44.353487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:44.354807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 11:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:44:44.359917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eca9-1d98-485e-a508-4ee4d2b30239 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:44.360879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eca9-1d98-485e-a508-4ee4d2b30239 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:44.360980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068eca9-1d98-485e-a508-4ee4d2b30239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:44.380636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d068eca9-1d98-485e-a508-4ee4d2b30239 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:44:44.381838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d068eca9-1d98-485e-a508-4ee4d2b30239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:44.389768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 11:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:44:44.691603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:44:44.693267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:44:44.706187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74e7c-343a-4b3f-8437-20fde1563837 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:44:44.709679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:44:44.710286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:44:44.710571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:44:44.710847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:44:44.719556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:44:44.720984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac71d-80ea-4d4a-9258-2bb5ed13b263 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:44:44.730214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 770/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:44:54.375282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:54.726126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:15.288383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.289516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.290023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.326478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.328107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.339375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 770/1540] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 29 11:46:15.348658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.349228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.349228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.379493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.380871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.393758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 771/1541] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.398522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.414391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b764-9d52-46a2-862e-439fb7f46347 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.423788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.424424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.424700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.424972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.425704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:15.426006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.427756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9800aa-e2d7-46f3-b227-397551c6e58b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.445510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 771/1542] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:15.454732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.464729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3108d0-fa33-48f8-9c8c-ac9c34f76deb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.475888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.476529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.476810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.477100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.477875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.479432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3de3-413a-4567-a1e4-6c6e3b8a54c4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.479720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3de3-413a-4567-a1e4-6c6e3b8a54c4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.479851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f201f9d-3704-4d6b-bc24-ae83cb5e2992 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.480028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3de3-413a-4567-a1e4-6c6e3b8a54c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.520214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ea8f3de3-413a-4567-a1e4-6c6e3b8a54c4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.524413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea8f3de3-413a-4567-a1e4-6c6e3b8a54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.541847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 772/1543] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 29 11:46:15.543523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506d2e-bf7b-47c3-b6fc-8adf4a8a0182 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.544587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506d2e-bf7b-47c3-b6fc-8adf4a8a0182 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.545167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506d2e-bf7b-47c3-b6fc-8adf4a8a0182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.552340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 772/1544] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:15.552340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.552340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.552340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.578820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b2506d2e-bf7b-47c3-b6fc-8adf4a8a0182 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.580411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b2506d2e-bf7b-47c3-b6fc-8adf4a8a0182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.585120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.586331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.671668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 773/1545] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.672000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 773/1546] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.672915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.678118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049df4-0dba-4804-b50a-4dd50a92f398 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.678405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049df4-0dba-4804-b50a-4dd50a92f398 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.678680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049df4-0dba-4804-b50a-4dd50a92f398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.684910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c348-8f8c-4022-bc0d-d2f46cce4fee None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.689984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.690603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.690881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.691200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.691859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.692875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:15.692875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:46:15.692875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:46:15.694207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fdf3f-5c43-46be-9646-c45de2e13a41 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.698540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b5049df4-0dba-4804-b50a-4dd50a92f398 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.699668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b5049df4-0dba-4804-b50a-4dd50a92f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.708422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 774/1547] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.709722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a67f-41fe-4eee-8efa-6b70ad278cf9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.710012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a67f-41fe-4eee-8efa-6b70ad278cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.710457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a67f-41fe-4eee-8efa-6b70ad278cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.717487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 774/1548] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:15.718925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c8c4-be43-423c-9fde-c3824b6ea3f4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.719215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c8c4-be43-423c-9fde-c3824b6ea3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.719517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c8c4-be43-423c-9fde-c3824b6ea3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.732506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3ef7a67f-41fe-4eee-8efa-6b70ad278cf9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.733754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ef7a67f-41fe-4eee-8efa-6b70ad278cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.738429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2a01c8c4-be43-423c-9fde-c3824b6ea3f4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.739587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2a01c8c4-be43-423c-9fde-c3824b6ea3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.741827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 775/1549] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.743109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb5aa-aa76-4687-b90f-a0ce2c6dc47c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.743403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb5aa-aa76-4687-b90f-a0ce2c6dc47c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.743686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb5aa-aa76-4687-b90f-a0ce2c6dc47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.749156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 775/1550] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.750592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4143-1c42-4e52-a392-4291e5209bc6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.750878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4143-1c42-4e52-a392-4291e5209bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.751154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4143-1c42-4e52-a392-4291e5209bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.764744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bbfdb5aa-aa76-4687-b90f-a0ce2c6dc47c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.765972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbfdb5aa-aa76-4687-b90f-a0ce2c6dc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.771036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4acc4143-1c42-4e52-a392-4291e5209bc6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.772162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4acc4143-1c42-4e52-a392-4291e5209bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.773794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 776/1551] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.775056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.775341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.775613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.786691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 776/1552] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.788097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.788385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.788657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.800310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.801560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.807748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.808905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.810591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 777/1553] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.811398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.819711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 777/1554] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.820570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.820696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60541-bdec-4dd1-8717-26f3eec8ca94 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.825876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.826674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.826956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.827239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.827979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:15.828244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.829884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd87119-4ab0-4275-a203-c7e250009fe6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.831349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03df1c5-5130-41b9-8f87-2314e5e3f24c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.835915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.836510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.836787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.837057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.837769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.839368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b489-1c17-4525-9420-61c66e445b0f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.848794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 778/1555] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:15.848794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561291a-5136-4973-b903-1fe824a713a6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.848794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561291a-5136-4973-b903-1fe824a713a6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.848794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561291a-5136-4973-b903-1fe824a713a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.849670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 778/1556] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:15.850902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178b0e-e754-46dd-98e2-b9409fd39bed None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.851182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178b0e-e754-46dd-98e2-b9409fd39bed None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.851453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178b0e-e754-46dd-98e2-b9409fd39bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.866397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f561291a-5136-4973-b903-1fe824a713a6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.867606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f561291a-5136-4973-b903-1fe824a713a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.870601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-66178b0e-e754-46dd-98e2-b9409fd39bed None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.871743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-66178b0e-e754-46dd-98e2-b9409fd39bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.875919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 779/1557] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.877234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.877616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.877878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.879902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 779/1558] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.881562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.881854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.882228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.898172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.899382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.904909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:15.906759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:15.907973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 780/1559] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.908762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.915168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 780/1560] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:15.916206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.921387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16fe9-f1d2-44a1-9449-af8d35830458 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.926098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.926256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9a61-4403-49fe-9aa1-a7cd40edf6f2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.926708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.927105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.927382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.928077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:15.928378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.930008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.930764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.931372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.931643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.931910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.932588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:15.932888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.933919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:15.933919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:46:15.933919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:46:15.935006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.941697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 781/1561] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:15.942467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.953890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 781/1562] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:15.953890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.954590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08ecf-a536-491c-82b0-226356e19b9e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.959182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bdf03-6cca-4774-b14c-ffed38ed55eb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.959425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.960030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.960312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.960587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.961241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.962283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:15.962283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:46:15.962283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:46:15.963476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.964473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.965190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.965523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.966349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:15.967042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:15.968625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:15.979226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 782/1563] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:15.980258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.990435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3fde-a23b-4213-b3d1-780a3412fbdc admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:15.993082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 782/1564] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:15.993082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:15.998522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:15.999156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:15.999424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:15.999704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.000398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:16.000703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.002339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.014630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 783/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:16.015434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.026924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655307-1746-4c0f-ab1f-4dae5826a08c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.049721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.053705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.071109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8891-97a4-4006-b9aa-83ca96a5597c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.076588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.077206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.077520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.077794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.078480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:16.078786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.080370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.088160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.088779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.089059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.089331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.090039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:16.090342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.092519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.092648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 783/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:16.093342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.104429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42069-3de6-400d-b632-aac659197a59 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.104607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 784/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:16.105535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.113555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.114180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.114461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.114736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.115454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:16.115757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.115931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251b2f-56f1-496c-9373-4180081c0c87 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.117367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.120678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.121288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.121617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.121948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.122613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.124499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.129872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 784/1568] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:16.136927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.142719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca73b5-b096-4189-9e56-80c3fc9a3ccc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.147686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.148290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.148572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.148844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.149533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.151431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.152925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 785/1569] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.154552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.181781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 785/1570] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.182686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.226242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cea82-d97c-4469-9638-7d7c8330fcbe admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.249544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c43c-4f02-4f50-82af-f3d29255a32d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.254229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.254833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.255116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.255391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.256082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.258059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.279820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 786/1571] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.280644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.286402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.287191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.287354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.287625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] PATH_INFO: `/v3/projects/90047b9130334326ad98280a8edb2bc6/users/ee3506015d9240258cbada860704dffe/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.291882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca314-7f5e-4604-9e3b-a0543ac6f36f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.296800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.297408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.297722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.298002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.298660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.300586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.302097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=90047b9130334326ad98280a8edb2bc6, user_id=ee3506015d9240258cbada860704dffe, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.304741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.317945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 786/1572] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:16 2022] PUT /identity/v3/projects/90047b9130334326ad98280a8edb2bc6/users/ee3506015d9240258cbada860704dffe/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:16.318911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.335904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 787/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.335904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.349975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.383313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46941a-9c51-4849-9a71-3b8812b555ef admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.397155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e450b8-e4c1-4ced-b0ca-3072429dc5a0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.401905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.402442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.402695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.402966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.404173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.406124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.426069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.434861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 788/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.435646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.444732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.445590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.445874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.446154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.446905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.448849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.476711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 787/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.477583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.499655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e8d7-d26c-4a54-a28c-c23a988d971c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.538887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85fa9-420b-48f6-92ed-dfce7daa28a0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.543802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.544555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.544836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.545111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.545799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.548212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.557120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.557776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.558057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.558333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.558989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.560959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.569935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 788/1576] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.571043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.581397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb623-61e6-4f71-9161-24949324f28c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.586625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.587267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.587546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.587838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.588473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.591111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4591d78-e92b-433c-9483-4fe134636f42 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.594759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 789/1577] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.594759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.616400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 789/1578] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.616400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.616400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.616400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.633902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:16.635095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:16.661291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfeec-7b55-48fa-88f4-7e0db21a67f7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.662132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.666208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.666828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.667168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.667447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.668120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.669854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.679939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 790/1579] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.682457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.691993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe61a1-91c8-44bc-8bfa-4cc8bcd2957b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.696604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.697190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.697499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.697777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.698430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.698535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 790/1580] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:16.699625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.701100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.711082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26e26-8a9b-49f4-a5f2-f5376762ff92 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.717093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.717773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.718053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.718330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.718990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.720906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.723193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 791/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 279 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.726443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.736082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613f69-cad6-4d36-9295-478cb373a9ef admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.740756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.741363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.741670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.741943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.742602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.746964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 791/1582] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.747123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.747222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.754570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c43-5bdc-44ce-a305-7cd94063a8c3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.756038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:16.759800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.760625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.760943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.761313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.762895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.764944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.773686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 792/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.773686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.778714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 792/1584] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.778714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.782487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5722d-a490-43da-bb5a-68a5b0ac2434 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.786491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8744d4-c8cc-427f-8aa0-6bff62fa853a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.787390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.788005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.788289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.788566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.789257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.791247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.791459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.792170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.792457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.792719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.793398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.795503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.806650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 793/1585] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.807389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.813786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 793/1586] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:16 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:16.814265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.820406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21cda7-60cc-4945-9d53-508c41133c95 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.825982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.826620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.826906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.827184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.827908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.829590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.839594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 794/1587] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.840610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.850521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9d0c-d41e-4180-8073-fb6e3780f2ec admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.855101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.855692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.855972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.856403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.857097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.858725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.868561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 795/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.870325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.874156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c331b-4cd6-4d1e-823e-202cd4812404 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.877965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.878593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.878993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.879302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.880040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fa23f-5203-4bda-b02c-46a049c4f0ea admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.884619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.885205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.885509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.885790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.886467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.888932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.889535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.890949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.899638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 796/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.900737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.901101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 794/1590] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:16.901926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.913918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e30701-c4c0-45cc-8b56-fe57ce453af6 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.914091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9fc7-5d28-4006-88c5-5b4027f6704f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.918892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.919076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.919653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.919787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.920015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.920137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.920294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.920402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.920980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.921107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.922618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.922757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.933571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 797/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.933868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 795/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.934633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.935041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.945789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54057-1b68-4fb1-a53e-2f733b939d71 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.949345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465e5cc-1899-4638-964f-95c05e95a406 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.951450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.952071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.952374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.952630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.953373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.954914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.955062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.955652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.955964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.956300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.957054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.958545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:16.966937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 796/1593] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.967655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.976375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 798/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:16.976375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:16.981181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d1956-28b6-4843-84d8-931f98867e7b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.987403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333d70-9898-4e78-af1f-d3bf38dbbb7e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:16.987552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.988127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.988486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.988823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] PATH_INFO: `/v3/projects/611c639220284cab87b19620d598af86/users/d1d9a261f74d4ad1a45900627ce562b1/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.993398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:16.993592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:16.993848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:16.994133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:16.994881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:16.996600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.007767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611c639220284cab87b19620d598af86, user_id=d1d9a261f74d4ad1a45900627ce562b1, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.012005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:17.012005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:46:17.012005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:46:17.013153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 799/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:17.013153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.013326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.022817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140095-dad0-4df2-85d3-6395b35d7cc4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.034074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 797/1596] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:16 2022] PUT /identity/v3/projects/611c639220284cab87b19620d598af86/users/d1d9a261f74d4ad1a45900627ce562b1/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.034074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.101725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.102360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.102753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.103027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.107310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.107310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.111179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55655fa0-1cf5-4a4a-860b-1d2c0323c394 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.117235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.117960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.118425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.118526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 800/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:17.118756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.119491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.119785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.122820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.131489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17699-918b-42e5-a31e-060ba9e3829f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.134955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 798/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:17.136073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.136843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.138883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.139232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.139595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] PATH_INFO: `/v3/projects/4f1a81a798d54d0eb9a787289be6f550/users/a64cc54aaea748538d67bc07861f0d3b/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.148055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576d30-3dcb-4e27-921b-2e115ffd14c0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.153492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.154302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.154741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.155019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.155711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.156166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1a81a798d54d0eb9a787289be6f550, user_id=a64cc54aaea748538d67bc07861f0d3b, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.157815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.158880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.168201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.169868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 799/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:17.170705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.177488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 801/1600] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/4f1a81a798d54d0eb9a787289be6f550/users/a64cc54aaea748538d67bc07861f0d3b/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.177488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.181878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb33b7-3332-4737-aa44-6d093eea277d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.206807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.262662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.264090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.264481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.265147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] PATH_INFO: `/v3/projects/3261a30431d343a1bb170b67199c0903/users/966689d952e14c1fb9007f2bdd7f03d3/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.267994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e622669-e139-4a64-ba23-9d123b624180 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.273109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.273822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.274106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.274384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] PATH_INFO: `/v3/projects/1ff908d615634070a538b80f0530879e/users/59152ef62412462f82699acf54c5b833/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.285823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3261a30431d343a1bb170b67199c0903, user_id=966689d952e14c1fb9007f2bdd7f03d3, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.289941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533c3fd-2cba-4e85-b121-b1d8d496f78b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.290508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff908d615634070a538b80f0530879e, user_id=59152ef62412462f82699acf54c5b833, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.293503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.314314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 800/1601] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/3261a30431d343a1bb170b67199c0903/users/966689d952e14c1fb9007f2bdd7f03d3/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.315700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.315993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.316271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.323079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 802/1602] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/1ff908d615634070a538b80f0530879e/users/59152ef62412462f82699acf54c5b833/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.324450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.347886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] MFA Rules not processed for user `d1d9a261f74d4ad1a45900627ce562b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.349128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.420725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e6852-7453-4574-852c-7f2ff1e1113b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.428073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 801/1603] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:17.429241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.485821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.486519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.486800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.487217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] PATH_INFO: `/v3/projects/7e6a56cc24794db2aa79d43a94c28226/users/8017ab3d0706435aa920657a00405425/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.500308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa0ae-3e3d-45d5-8fc5-03ed7e6d11f0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.503202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6a56cc24794db2aa79d43a94c28226, user_id=8017ab3d0706435aa920657a00405425, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.505111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.505823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.506210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.506381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] PATH_INFO: `/v3/projects/6a4b9969357142bc8724804eb47e0c48/users/1a343996462b462d86fb89b876f4e127/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.506835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.522635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 803/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/7e6a56cc24794db2aa79d43a94c28226/users/8017ab3d0706435aa920657a00405425/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.523509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.529848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4b9969357142bc8724804eb47e0c48, user_id=1a343996462b462d86fb89b876f4e127, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.532703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deba8a-fd73-486e-9447-591088968320 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.545707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.551868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 802/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/6a4b9969357142bc8724804eb47e0c48/users/1a343996462b462d86fb89b876f4e127/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.551868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e4c3-f138-4bfa-b5fa-e3fc50dfc40d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.551868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e4c3-f138-4bfa-b5fa-e3fc50dfc40d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.551868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e4c3-f138-4bfa-b5fa-e3fc50dfc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.574163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.587652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c839e4c3-f138-4bfa-b5fa-e3fc50dfc40d None None] MFA Rules not processed for user `a64cc54aaea748538d67bc07861f0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.589404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c839e4c3-f138-4bfa-b5fa-e3fc50dfc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.614244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db2f0-92c4-468d-9d82-efdb9a29d891 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.690616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 803/1606] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:17.692072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dcdf8-763b-462b-8710-f596a04c8249 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.692477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dcdf8-763b-462b-8710-f596a04c8249 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.692839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dcdf8-763b-462b-8710-f596a04c8249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.711447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.712278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.712607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.712954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] PATH_INFO: `/v3/projects/106664c99e9c4a0d9a9c9c05e08a3d7f/users/9d341bba8dda445ca4eac6d52aa9f80c/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.733745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4f5dcdf8-763b-462b-8710-f596a04c8249 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.735611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4f5dcdf8-763b-462b-8710-f596a04c8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.739744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106664c99e9c4a0d9a9c9c05e08a3d7f, user_id=9d341bba8dda445ca4eac6d52aa9f80c, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.744870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 804/1607] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:17.746469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8687204-96ca-43af-81df-33db4401771d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.755817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8687204-96ca-43af-81df-33db4401771d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.756255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.756403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8687204-96ca-43af-81df-33db4401771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.777294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 804/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:17 2022] PUT /identity/v3/projects/106664c99e9c4a0d9a9c9c05e08a3d7f/users/9d341bba8dda445ca4eac6d52aa9f80c/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:17.779175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:17.790807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c8687204-96ca-43af-81df-33db4401771d None None] MFA Rules not processed for user `59152ef62412462f82699acf54c5b833`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.792415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c8687204-96ca-43af-81df-33db4401771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.870487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb9986-d047-4b27-b1f8-3faef090dd76 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:17.879155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:17.880440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.880440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.880440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.880988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:17.883107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc1b58-41d2-4051-8aeb-28d9c0fd913a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:17.894116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 805/1609] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:17.895948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91ccc-9ea9-4cb1-8c7d-22d6006119ce None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.896626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91ccc-9ea9-4cb1-8c7d-22d6006119ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.897131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91ccc-9ea9-4cb1-8c7d-22d6006119ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.926748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 805/1610] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:17.926958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d36d-f63a-4ccb-927f-f66887c0e2e6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:17.927335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d36d-f63a-4ccb-927f-f66887c0e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:17.927526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d36d-f63a-4ccb-927f-f66887c0e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:17.936725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-32d91ccc-9ea9-4cb1-8c7d-22d6006119ce None None] MFA Rules not processed for user `8017ab3d0706435aa920657a00405425`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.938466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-32d91ccc-9ea9-4cb1-8c7d-22d6006119ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.957984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6065d36d-f63a-4ccb-927f-f66887c0e2e6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:17.959450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6065d36d-f63a-4ccb-927f-f66887c0e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:17.987020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.029173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 806/1611] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:18.031896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.032189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.032471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.034467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 807/1612] 10.222.0.60 () {54 vars in 962 bytes} [Fri Jul 29 11:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:18.035336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.038019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:18.053366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 806/1613] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:18.056230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.057220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.057660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.066433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.093294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:18.096241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:18.107924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 807/1614] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:18.112670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.126559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ff06-814f-4ccd-8f7a-81bbb30472a7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.129240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e78b-4834-447c-aa5b-70998c8437dd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.133555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.134336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.134841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.135187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.135664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.136730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.138307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.138779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.139615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.141690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a9fc-0d00-4b12-a4c6-7a2a392b2edd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.152485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.155405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.166818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 808/1615] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:18.168140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.180728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a60a0-8724-4484-b5a8-a158f2c03690 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.184788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 808/1616] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:18.186483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd330f-bdd0-47cf-9ab4-0bcf5d0d9943 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.189515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd330f-bdd0-47cf-9ab4-0bcf5d0d9943 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.189970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd330f-bdd0-47cf-9ab4-0bcf5d0d9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.265068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-94cd330f-bdd0-47cf-9ab4-0bcf5d0d9943 None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:18.267507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-94cd330f-bdd0-47cf-9ab4-0bcf5d0d9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:18.294324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.294881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.296166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.297669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.298411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.303091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.343066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 809/1617] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:18.344015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.415364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 809/1618] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:18.417110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39abc-2522-479e-ae89-e8e6f1c8aacd None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.417488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39abc-2522-479e-ae89-e8e6f1c8aacd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.417862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39abc-2522-479e-ae89-e8e6f1c8aacd None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.420898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 810/1619] 10.222.0.60 () {54 vars in 962 bytes} [Fri Jul 29 11:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:18.422101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39abc-2522-479e-ae89-e8e6f1c8aacd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.480285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d7f99-d714-4c47-948e-1de4845cc335 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.492029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.493379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.493701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.494033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.518235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.519848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.530884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 810/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:18.531719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.555941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9888dd-79e1-4bb5-97c8-7a1789b5707a service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.562652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.563071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39abc-2522-479e-ae89-e8e6f1c8aacd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.563287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.563711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.563999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.564679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.566977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee58f23-f42b-4bf3-a3e8-1105bc575d7b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.568412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.569088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.569367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.570535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.598091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.600676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.616492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 811/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:18.617831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.623300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 811/1622] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:18.625514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.625973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.626425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.630000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171ef35-84ad-46e9-b51d-56ac7abe3fe7 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.636166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.637583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.638038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.639487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.640914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.642832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.657485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 812/1623] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:18.658519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.661722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:18.663098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:18.680225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aeeb8-d5df-4451-b9d0-e84cda7cfab4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.681323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 812/1624] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Jul 29 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:18.682254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.687732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.689003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.690197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.690644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.694517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b8ae-3326-4cbe-810b-dbe5a4aabc2c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.700163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.708351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.709920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.710181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.710373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.711178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.713911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.740895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 813/1625] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:18.742438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.765834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb84ea-a56c-4118-b7d0-dbc345fd2591 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.775267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.779623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.781747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.782126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] PATH_INFO: `/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b/users/743f69636d134ce18def740b1ab1a2de/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.817812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.819907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.834253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 813/1626] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:18.835233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:18.836837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.845579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1fa945b7f14f4f9e97f1d13e32c05b, user_id=743f69636d134ce18def740b1ab1a2de, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:18.849719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:18.855135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f16f7-3ae0-4ac4-8cb8-9a6b5838d61d service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:18.869164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:18.938052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:18.938052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:18.938052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:18.953573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 814/1627] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:18 2022] PUT /identity/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b/users/743f69636d134ce18def740b1ab1a2de/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:18.953573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.025244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.025679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b6f-881c-4ab1-90bc-555ea9e58728 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.026999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.031927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.032666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.032951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.033232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] PATH_INFO: `/v3/projects/c8ea867386ab4a13b2a10bf309366075/users/eaaca8262b6842fc857c0a4e0b36d5e4/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.038302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 814/1628] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:19.039606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.052100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19faf8-a3dd-4483-843d-6ab727f8b556 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.052306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ea867386ab4a13b2a10bf309366075, user_id=eaaca8262b6842fc857c0a4e0b36d5e4, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.055418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.057175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.057462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.057751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.058015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.058965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.061605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.077352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 815/1629] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:19.078318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.084692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 815/1630] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:18 2022] PUT /identity/v3/projects/c8ea867386ab4a13b2a10bf309366075/users/eaaca8262b6842fc857c0a4e0b36d5e4/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:19.088585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.103902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a782-6c3c-4368-a203-597759619991 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.183795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.184713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.185126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.190868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] PATH_INFO: `/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b/users/743f69636d134ce18def740b1ab1a2de/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.195796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1fa945b7f14f4f9e97f1d13e32c05b, user_id=743f69636d134ce18def740b1ab1a2de, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.204804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26c9f2-9650-4fca-b579-113f50b55754 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.232024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 816/1631] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:19 2022] PUT /identity/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b/users/743f69636d134ce18def740b1ab1a2de/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:19.240107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb687-7eab-4d73-94f0-eb4945a174b8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.243259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fd38-3cfa-447c-b4a8-2d7137792bd0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.243259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fd38-3cfa-447c-b4a8-2d7137792bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.243259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fd38-3cfa-447c-b4a8-2d7137792bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.308959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8d30fd38-3cfa-447c-b4a8-2d7137792bd0 None None] MFA Rules not processed for user `743f69636d134ce18def740b1ab1a2de`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:19.315759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8d30fd38-3cfa-447c-b4a8-2d7137792bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:19.359930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:19.393766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.395069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.395517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.395944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.396789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.400395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb67749-1707-4441-ab36-ccaeaa436afd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.420337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 816/1632] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:19.422098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141c9-9810-495b-9d70-c6a1593cb520 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.422559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141c9-9810-495b-9d70-c6a1593cb520 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.423004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8141c9-9810-495b-9d70-c6a1593cb520 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.430131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 817/1633] 10.222.0.60 () {54 vars in 912 bytes} [Fri Jul 29 11:46:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:19.438570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8141c9-9810-495b-9d70-c6a1593cb520 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.444435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 817/1634] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:19.444435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845372ba-4ed7-4664-8086-cf8e085723fa None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.444435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845372ba-4ed7-4664-8086-cf8e085723fa None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.444435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845372ba-4ed7-4664-8086-cf8e085723fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.471061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8141c9-9810-495b-9d70-c6a1593cb520 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.473534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-845372ba-4ed7-4664-8086-cf8e085723fa None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:19.475327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-845372ba-4ed7-4664-8086-cf8e085723fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:19.479135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.480467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.480913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.482374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] PATH_INFO: `/v3/projects/c8ea867386ab4a13b2a10bf309366075/users/eaaca8262b6842fc857c0a4e0b36d5e4/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.487118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ea867386ab4a13b2a10bf309366075, user_id=eaaca8262b6842fc857c0a4e0b36d5e4, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.490792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.526280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 818/1635] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:19 2022] PUT /identity/v3/projects/c8ea867386ab4a13b2a10bf309366075/users/eaaca8262b6842fc857c0a4e0b36d5e4/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:19.528520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.539854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:19.633863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 818/1636] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:19.637841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7219-3145-449f-a6ca-d946e108fa52 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.640389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7219-3145-449f-a6ca-d946e108fa52 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.649938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7219-3145-449f-a6ca-d946e108fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.669924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c874-31f2-4818-936a-a924961f34f9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.676797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.678413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.678880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.679401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.740630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f94a7219-3145-449f-a6ca-d946e108fa52 None None] MFA Rules not processed for user `eaaca8262b6842fc857c0a4e0b36d5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:19.742093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f94a7219-3145-449f-a6ca-d946e108fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:19.818932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:19.823180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6abfc-729b-49e1-ac00-8319727dfb2b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:19.838357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 819/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:19.842069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f30a-41b5-42aa-b4bc-c898a40da601 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.842367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f30a-41b5-42aa-b4bc-c898a40da601 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.842725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f30a-41b5-42aa-b4bc-c898a40da601 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.844772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 820/1638] 10.222.0.60 () {54 vars in 912 bytes} [Fri Jul 29 11:46:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:19.845658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f30a-41b5-42aa-b4bc-c898a40da601 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:19.862097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f30a-41b5-42aa-b4bc-c898a40da601 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:19.869218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:19.869933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.870222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.870505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.922356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 819/1639] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:19.925096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:19.927346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:19.928900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:19.979598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:19.982081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:20.026182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:20.033263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:20.041736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:20.066365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 821/1640] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:20.068175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:20.090124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b79aa-42d6-4228-9b41-43b3770ffa64 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:20.102134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:20.104658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:20.107652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:20.108680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:20.133952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:20.138237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:20.146762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 820/1641] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:20.162530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 822/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:20 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:20.329289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:20.344904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37867-3edc-42a1-8544-096a26b1d747 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:20.356616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:20.357282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:20.357602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:20.357882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:20.382826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:20.384344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:20.417661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 821/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:21.497327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:21.513486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f84f-09b3-4ffa-921c-4b5735c03fb8 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:21.535735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:21.536365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:21.536648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:21.536924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:21.588610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:21.688582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:21.694945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449307d-86bd-49aa-802e-9336b69b3f51 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:21.748912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 823/1644] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:22.882317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:23.066893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e78a-3621-43a8-8409-5430bde62b19 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:23.081211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:23.082324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:23.082785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:23.083214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] PATH_INFO: `/v3/users/d1d9a261f74d4ad1a45900627ce562b1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:23.086436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d9a261f74d4ad1a45900627ce562b1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:23.088586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:23.290366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d9a261f74d4ad1a45900627ce562b1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:23.326351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d9a261f74d4ad1a45900627ce562b1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:23.326351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d9a261f74d4ad1a45900627ce562b1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:23.326351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d9a261f74d4ad1a45900627ce562b1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:23.356882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d9a261f74d4ad1a45900627ce562b1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:23.397838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 822/1645] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:22 2022] DELETE /identity/v3/users/d1d9a261f74d4ad1a45900627ce562b1 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:23.402514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:23.403248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:23.403248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:23.441708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:23.442959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:23.613074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 824/1646] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:23.687523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:23.691777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:23.823660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:23.928486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f8413-75fa-4179-8224-405589d7a386 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:23.936325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:23.937325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:23.938118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:23.938543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:23.966285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:23.971696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:23.998549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 823/1647] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:24.779577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:24.781733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:24.814797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c724fe-b175-4e7d-aba7-3149798e2c4f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:24.826156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:24.826944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:24.827360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:24.827744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] PATH_INFO: `/v3/projects/611c639220284cab87b19620d598af86` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:24.829161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611c639220284cab87b19620d598af86)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:24.832936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:24.996972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611c639220284cab87b19620d598af86', 'request_id': 'req-9583495e-6027-4cd0-81e8-5b4471849b78'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.013746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611c639220284cab87b19620d598af86', 'request_id': 'req-9583495e-6027-4cd0-81e8-5b4471849b78'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.034918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611c639220284cab87b19620d598af86', 'request_id': 'req-9583495e-6027-4cd0-81e8-5b4471849b78'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.058116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] The token cache is being invalidate because project 611c639220284cab87b19620d598af86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:25.058409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.059979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.065886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 825/1648] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:24 2022] DELETE /identity/v3/projects/611c639220284cab87b19620d598af86 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:25.069691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:25.088944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f20ed-65e1-4102-82b7-fb16c7922e97 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:25.279773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:25.280437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:25.280914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:25.281339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] PATH_INFO: `/v3/users/743f69636d134ce18def740b1ab1a2de` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:25.282785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=743f69636d134ce18def740b1ab1a2de)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:25.285896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:25.411725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743f69636d134ce18def740b1ab1a2de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.412829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743f69636d134ce18def740b1ab1a2de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.430166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743f69636d134ce18def740b1ab1a2de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.430857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743f69636d134ce18def740b1ab1a2de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.474306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7ae0b075-a178-4d23-9077-236d8fad9b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743f69636d134ce18def740b1ab1a2de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:25.506563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 824/1649] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:25 2022] DELETE /identity/v3/users/743f69636d134ce18def740b1ab1a2de => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:26.653697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:26.657715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:26.672164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583495e-6027-4cd0-81e8-5b4471849b78 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:26.796315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:26.838407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:26.839438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:26.840624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:26.841408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] PATH_INFO: `/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:26.847597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1fa945b7f14f4f9e97f1d13e32c05b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:26.849972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:26.947630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1fa945b7f14f4f9e97f1d13e32c05b', 'request_id': 'req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:26.968331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1fa945b7f14f4f9e97f1d13e32c05b', 'request_id': 'req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:26.989112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1fa945b7f14f4f9e97f1d13e32c05b', 'request_id': 'req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:27.022230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] The token cache is being invalidate because project bd1fa945b7f14f4f9e97f1d13e32c05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:27.022550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:27.024392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34b3b5cc-adbd-4a52-b2c8-95d537da44a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:27.027387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 826/1650] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:26 2022] DELETE /identity/v3/projects/bd1fa945b7f14f4f9e97f1d13e32c05b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:27.032805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.033344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.033344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.088104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:27.092057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:27.254009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:27.299657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 825/1651] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:27.303206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.303206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.303512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.379394 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:27.380815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:27.402287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 827/1652] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:27.406744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:27.439314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7605-4053-4d9b-be47-bf67d041dc26 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:27.453842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:27.454541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.454818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.455087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.458424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:27.458786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:27.462442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:27.505772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 826/1653] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:27.507726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:27.521595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074c6b-e588-464b-ba7b-3c082a9ca93c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:27.551713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:27.552369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.552649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.552924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.553639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:27.555575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:27.655789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 828/1654] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:27 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:27.660000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:27.679844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d858-b2a3-4973-b09a-00e5f543f4d5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:27.823542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:27.824548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.825056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.825754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.826294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:27.829046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:27.884796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 827/1655] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:27 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:27.888583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:27.922363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabdb84-ae9f-4cc9-b45a-a33022d8b14f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:27.944875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:27.945563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:27.948719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:27.949063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:27.952947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:27.958488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:27.999292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 829/1656] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:28.004542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:28.019827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ccb3-6b2b-42f3-8836-31b928793c7c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:28.036028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:28.036808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.037316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.037520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.038636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:28.041252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787ccb1-482a-42b8-94a0-7d151f8d2b94 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:28.060078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 828/1657] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:46:28.064018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:28.083297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94e66-139f-44e7-b28e-63e537daf9b8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:28.091235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:28.092311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.092769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.093856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] PATH_INFO: `/v3/projects/7fa2e3e36e444bd7bca8712b9ea6eaae/users/33f9e49f133043f7a61a5e2a9d18759f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.127428 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa2e3e36e444bd7bca8712b9ea6eaae, user_id=33f9e49f133043f7a61a5e2a9d18759f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:28.130216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fa283-20d1-4efe-b5f0-7bd0262aa70a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:28.169812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 830/1658] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:28 2022] PUT /identity/v3/projects/7fa2e3e36e444bd7bca8712b9ea6eaae/users/33f9e49f133043f7a61a5e2a9d18759f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:28.179982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.180750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.181398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.217227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0bbd0-b163-45fa-9cef-f542ba7567ab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.217636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0bbd0-b163-45fa-9cef-f542ba7567ab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.218067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0bbd0-b163-45fa-9cef-f542ba7567ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.237010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] MFA Rules not processed for user `33f9e49f133043f7a61a5e2a9d18759f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:28.238255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:28.287442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0bb0bbd0-b163-45fa-9cef-f542ba7567ab None None] MFA Rules not processed for user `966689d952e14c1fb9007f2bdd7f03d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:28.288692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0bb0bbd0-b163-45fa-9cef-f542ba7567ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:28.391709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 829/1659] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:28.395637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:28.462939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 831/1660] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:28.475548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.475857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.476124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.488097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:28.527262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] MFA Rules not processed for user `966689d952e14c1fb9007f2bdd7f03d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:28.531058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:28.562672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 832/1661] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:28.563695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:28.565355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:28.565678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:28.591644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b181c-c7cf-41c8-afca-8136c6928721 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:28.601314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:28.602217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.602507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.602831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.604227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:28.607172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:28.647934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 830/1662] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:28 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:46:28.649856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:28.652138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:28.727103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4161d01-ea8b-4459-af61-b5ef3f9c7b32 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:28.838256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:28.839572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.840212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.840761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] PATH_INFO: `/v3/users/8017ab3d0706435aa920657a00405425` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.844663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017ab3d0706435aa920657a00405425)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:28.846356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:28.846356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 29 11:46:28.846356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: Jul 29 11:46:28.848047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:28.877811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb392-9dba-4022-8bb7-2246b88dcf88 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:28.911989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:28.912910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:28.913360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:28.913813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:28.977688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017ab3d0706435aa920657a00405425'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:28.979007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017ab3d0706435aa920657a00405425'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:28.995138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017ab3d0706435aa920657a00405425'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:29.022641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017ab3d0706435aa920657a00405425'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:29.023380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f444b727-66ba-4a2e-a109-ed93e28bbb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017ab3d0706435aa920657a00405425'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:29.028305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.031975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.058127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 831/1663] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:29.061735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.100082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60505721-9a9f-41d4-b51f-07985a5a5d50 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.114461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.115327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.116786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.119348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.122311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 833/1664] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:28 2022] DELETE /identity/v3/users/8017ab3d0706435aa920657a00405425 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:29.126564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.128118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.128457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.128742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.133015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.194499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:29.195816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:29.212703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 832/1665] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:29 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:29.217094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.226666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:29.227200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:29.250376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcc009-a30a-4b01-b839-62a1b5168220 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.349869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:29.371118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.372278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.372829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.373179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.374075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.377777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 834/1666] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:29.378549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.402272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 833/1667] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:46:29.404091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.407062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:29.408163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.436144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c19ab-bc93-4f4d-a125-4da8b05f17ea admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.443625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.444322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.444607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.444945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] PATH_INFO: `/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b/users/8df4b763da0744b68dac46e5211a0ee0/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.479304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64102500ee934a5abcdb4ff2a40c5b8b, user_id=8df4b763da0744b68dac46e5211a0ee0, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.487298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.518183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 834/1668] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:29 2022] PUT /identity/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b/users/8df4b763da0744b68dac46e5211a0ee0/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:29.523070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.573388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efe86-7b95-497a-8ae0-5ac9b8b0d446 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.674141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.675290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.675548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.675828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.704229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141683f2-50cc-40bf-9377-bf2d59b7f845 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.708693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.709326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.709708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.709981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.710674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.712298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.737356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 835/1669] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:29.741107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:29.763600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab81ce6-bd1c-472c-84c6-b26ace08bd66 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:29.780268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:29.781095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.781386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.781702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] PATH_INFO: `/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b/users/8df4b763da0744b68dac46e5211a0ee0/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.787882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64102500ee934a5abcdb4ff2a40c5b8b, user_id=8df4b763da0744b68dac46e5211a0ee0, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.790598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.797646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:29.799540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700d2f-2da4-463f-a230-5d082a6ee994 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:29.812799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 835/1670] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:29.814948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 836/1671] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:29 2022] PUT /identity/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b/users/8df4b763da0744b68dac46e5211a0ee0/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:29.827247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c24e70-5b54-4f73-bf21-4e6d8fc129e3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:29.827798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c24e70-5b54-4f73-bf21-4e6d8fc129e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:29.829012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c24e70-5b54-4f73-bf21-4e6d8fc129e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:29.896790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-85c24e70-5b54-4f73-bf21-4e6d8fc129e3 None None] MFA Rules not processed for user `8df4b763da0744b68dac46e5211a0ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:29.898039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-85c24e70-5b54-4f73-bf21-4e6d8fc129e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:29.931812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:30.028713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 836/1672] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:30.037537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:30.039354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:30.160309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217e25-f409-4ac3-a93d-0b623c2a6d23 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:30.171473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:30.172128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:30.172407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:30.172678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:30.200789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:30.203729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:30.235481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 837/1673] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:30.347865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:30.348706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:30.349107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:30.409358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:30.417152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d913d03-0ac4-4b4e-8451-889b259b92a4 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:30.440121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:30.440777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:30.441061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:30.441338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:30.443127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] MFA Rules not processed for user `ee3506015d9240258cbada860704dffe`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:30.444723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:30.460209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:30.593373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:30.623246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 837/1674] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:30.624382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:30.631201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:30.631465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:30.632792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:30.650137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 838/1675] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:30.670675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:30.681146 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:30.845994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20af54-49c4-4583-a6f1-d43e47dd2d4e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:30.856597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:30.860392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:30.861293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:30.861822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] PATH_INFO: `/v3/users/a64cc54aaea748538d67bc07861f0d3b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:30.864899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64cc54aaea748538d67bc07861f0d3b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:30.876189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:30.989658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:30.994839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64cc54aaea748538d67bc07861f0d3b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:30.996584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64cc54aaea748538d67bc07861f0d3b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:31.013845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64cc54aaea748538d67bc07861f0d3b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:31.016951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f107c-1cd4-4ecf-b778-98d5ad423e08 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:31.030008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64cc54aaea748538d67bc07861f0d3b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:31.031677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-adc1dbde-a982-4c32-9cb8-03ac615817d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64cc54aaea748538d67bc07861f0d3b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:31.040817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:31.041489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.041779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.042059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.045954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:31.071120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:31.075294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef257-c775-4a6b-ade2-7c1e55360c1d service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:31.104798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 838/1676] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:30 2022] DELETE /identity/v3/users/a64cc54aaea748538d67bc07861f0d3b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:31.106070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 839/1677] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:31.110163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0661-4526-4348-a725-ac322851d16c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.110584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0661-4526-4348-a725-ac322851d16c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.110970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0661-4526-4348-a725-ac322851d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.122807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af55-f542-4436-a131-76fb80b7808d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.126758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af55-f542-4436-a131-76fb80b7808d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.127064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af55-f542-4436-a131-76fb80b7808d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.135398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 839/1678] 10.222.0.60 () {54 vars in 912 bytes} [Fri Jul 29 11:46:31 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:31.140809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.141097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.141375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.168683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f56a0661-4526-4348-a725-ac322851d16c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:31.183624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f56a0661-4526-4348-a725-ac322851d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:31.254325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:31.255687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:31.345223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 840/1679] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:31.398484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0661-4526-4348-a725-ac322851d16c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:31.401130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f56a0661-4526-4348-a725-ac322851d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:31.478264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 840/1680] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:31.590651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0661-4526-4348-a725-ac322851d16c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:31.595490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:31.597314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:31.601152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:31.602081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.602535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.602964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.623613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ae5c3-ce55-4275-a9c8-a923e681baa4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:31.624778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:31.626441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:31.634300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:31.636269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:31.637548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:31.638855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:31.659734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:31.663925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27b7f-b8bd-405e-8b4c-0847d8823424 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:31.674631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 841/1681] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:31.697761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 841/1682] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:32.475538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:32.481663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:32.509247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7075-898b-47de-b010-83c3d635eeae service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:32.539374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:32.540333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:32.549290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:32.550137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] PATH_INFO: `/v3/projects/4f1a81a798d54d0eb9a787289be6f550` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:32.551712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1a81a798d54d0eb9a787289be6f550)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:32.552948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: WARNING py.warnings [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:46:32.552948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: warnings.warn(msg) Jul 29 11:46:32.552948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: Jul 29 11:46:32.554686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:32.592356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:32.706565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1a81a798d54d0eb9a787289be6f550', 'request_id': 'req-c2e888d8-f243-4b99-a871-ef05de797cd8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:32.721072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1a81a798d54d0eb9a787289be6f550', 'request_id': 'req-c2e888d8-f243-4b99-a871-ef05de797cd8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:32.763835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1a81a798d54d0eb9a787289be6f550', 'request_id': 'req-c2e888d8-f243-4b99-a871-ef05de797cd8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:32.813780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] The token cache is being invalidate because project 4f1a81a798d54d0eb9a787289be6f550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:32.813992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:32.815077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c2e888d8-f243-4b99-a871-ef05de797cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:32.817126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 842/1683] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:32 2022] DELETE /identity/v3/projects/4f1a81a798d54d0eb9a787289be6f550 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:32.822103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:32.822620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:32.822710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:32.883375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:32.884790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:33.035802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 842/1684] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:33.043993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.044501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.045010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.095599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:33.096843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:33.121441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 843/1685] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:33.125598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.136227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398ff2-dde8-4f87-b72f-533a9e555e03 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.147660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.148478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.148761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.149052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.149781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:33.150235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.151942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.167774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 843/1686] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:33.172314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.182358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453d200-4d09-47ba-a98c-ed37d98c5719 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.188670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.189685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.190181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.190670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.191570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.195098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.248682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.256396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 844/1687] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:33 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:33.262955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999157b-e9aa-42fe-a135-7494eec65f97 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.333638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.336358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:33.353284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:33.453717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.455100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.455850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.456414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.458133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.462526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.515773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 844/1688] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:33 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:33.516880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.536204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef672e81-f93a-4580-8178-4ca271e46f91 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.542823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f39416-931c-49fe-bb3e-64e1853e1dee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.550685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.553231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.553829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.554811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] PATH_INFO: `/v3/projects/7e6a56cc24794db2aa79d43a94c28226` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.556355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6a56cc24794db2aa79d43a94c28226)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.559381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.561165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.576302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.576809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.579192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.579992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.584186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.632701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 845/1689] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:33.636071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.661039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a62c9-dcea-4d55-a6ad-a0688161421a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.682845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:33.683380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.686292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.686594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.687380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:33.700145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:33.705245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6a56cc24794db2aa79d43a94c28226', 'request_id': 'req-cfbff841-b262-4174-9c70-f2472c5757a1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:33.722501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6a56cc24794db2aa79d43a94c28226', 'request_id': 'req-cfbff841-b262-4174-9c70-f2472c5757a1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:33.738554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6a56cc24794db2aa79d43a94c28226', 'request_id': 'req-cfbff841-b262-4174-9c70-f2472c5757a1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:33.739828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 846/1690] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:33.749938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:33.763122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:33.769873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] The token cache is being invalidate because project 7e6a56cc24794db2aa79d43a94c28226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:33.770178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:33.775155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cfbff841-b262-4174-9c70-f2472c5757a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:33.782786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 845/1691] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:33 2022] DELETE /identity/v3/projects/7e6a56cc24794db2aa79d43a94c28226 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:33.784918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784cd-c60b-4e3f-92d8-8a21da846ad2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:33.785215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784cd-c60b-4e3f-92d8-8a21da846ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:33.785517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784cd-c60b-4e3f-92d8-8a21da846ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:33.788226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38328a5-5bda-46a6-80cd-80edde6ad52d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:33.824896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a51784cd-c60b-4e3f-92d8-8a21da846ad2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:33.827886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a51784cd-c60b-4e3f-92d8-8a21da846ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:34.027035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.028573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.028865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.029147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] PATH_INFO: `/v3/projects/99ead974f26c41dcbd2cb25140acb05d/users/21ef5c2a08554251ae71936bcefcdb4a/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.075199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 846/1692] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:34.078104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.078820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.079406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.081532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ead974f26c41dcbd2cb25140acb05d, user_id=21ef5c2a08554251ae71936bcefcdb4a, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.088774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f905a-ddb0-4664-8bd3-698a18ebc3b7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.142505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 847/1693] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:33 2022] PUT /identity/v3/projects/99ead974f26c41dcbd2cb25140acb05d/users/21ef5c2a08554251ae71936bcefcdb4a/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:34.144518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.144913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.145025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:34.145433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.147471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:34.283964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] MFA Rules not processed for user `21ef5c2a08554251ae71936bcefcdb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:34.286069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:34.307025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 847/1694] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:34.308397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.324883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4154-51e0-42f3-9ad8-4e9e228e4046 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.331213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.332479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.332479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.332811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.333970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:34.334384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.336172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.383828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 848/1695] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:34.385516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.430886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70004a-7903-45f8-94a3-711aada6657d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.455060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.456097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.456801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.458000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.459378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.463134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.532693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 849/1696] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:34.534241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.587793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 848/1697] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:34.592769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.595592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:34.646300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803bd03-e38d-44ba-8562-1754d8c7ed69 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.680683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:34.696514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48cf8-1667-4171-9a79-7b4074a27f49 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.711335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.711896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.712167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.712442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.713116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.715273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.748340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:34.771217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 850/1698] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:34.772975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.799633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1650-6a55-4cb4-82db-4356bac8ff59 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.813090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.813814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.814107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.814362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.815060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.818031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.853503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 851/1699] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:34.854473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.854768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.856252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.856384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.857050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.857927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.861426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.877166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e6c32-3393-4758-b05d-c4476363481d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:34.890161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:34.891064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:34.891521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:34.892145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:34.893125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:34.898907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:34.924619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 852/1700] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:34.929766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.952846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 849/1701] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/projects => generated 403 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:46:34.954895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:34.955666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc0ab-d7e5-4545-8382-21557a301834 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:35.077032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:35.077816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.078099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.078373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] PATH_INFO: `/v3/projects/a0161f92ef0a41a6a146dae85bd21bf9/users/f0cde32605184fb7a440bb1567beb3e4/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.128181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0161f92ef0a41a6a146dae85bd21bf9, user_id=f0cde32605184fb7a440bb1567beb3e4, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:35.131741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc809af-be05-4032-a452-6488f63d745f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:35.188671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 853/1702] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:34 2022] PUT /identity/v3/projects/a0161f92ef0a41a6a146dae85bd21bf9/users/f0cde32605184fb7a440bb1567beb3e4/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:35.190304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16b0-365d-4f6a-8e48-302f29ad8588 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.203153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16b0-365d-4f6a-8e48-302f29ad8588 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.203537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16b0-365d-4f6a-8e48-302f29ad8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.213193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c429-38fd-4a94-8893-53bcfa45ebf5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:35.333219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f6ab16b0-365d-4f6a-8e48-302f29ad8588 None None] MFA Rules not processed for user `f0cde32605184fb7a440bb1567beb3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:35.336692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f6ab16b0-365d-4f6a-8e48-302f29ad8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:35.449429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:35.450470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.450755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.451028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.455031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:35.456998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d10b9-bda6-4da4-98db-7a92966cdcef admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:35.520883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 850/1703] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:34 2022] POST /identity/v3/users => generated 308 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:35.522814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6c28-21b4-41ff-bc21-681be9202531 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.523436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6c28-21b4-41ff-bc21-681be9202531 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.524097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6c28-21b4-41ff-bc21-681be9202531 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.529950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 851/1704] 10.222.0.60 () {54 vars in 961 bytes} [Fri Jul 29 11:46:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:35.531793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6c28-21b4-41ff-bc21-681be9202531 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:35.547507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 854/1705] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:35.549205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.552061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.553252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.566147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6c28-21b4-41ff-bc21-681be9202531 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:35.585577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:35.602952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.603409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.604004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.606874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:35.607199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:35.608515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:35.610296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:35.642170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 852/1706] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:35.644480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:35.681905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d267-b54e-48ec-bf75-334f2cb9488f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:35.698582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:35.699787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.700221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.700719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.706933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:35.714763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:35.719171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:35.773815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 855/1707] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Jul 29 11:46:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:35.774922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:35.798240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead1d77-2fbe-4502-a131-7574dd19f8f8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:35.808258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:35.809182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:35.809679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:35.810169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] PATH_INFO: `/v3/projects/7c30f7ddebf549d5a9e2443df60f5841/users/adaf5541b36246fca916491a209de27e/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:35.813994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 853/1708] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:35 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:35.819297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:35.832091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:35.851763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c30f7ddebf549d5a9e2443df60f5841, user_id=adaf5541b36246fca916491a209de27e, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:35.854658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:35.881199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 856/1709] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:35 2022] PUT /identity/v3/projects/7c30f7ddebf549d5a9e2443df60f5841/users/adaf5541b36246fca916491a209de27e/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:35.884912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:36.073065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685675-5125-4e94-95a5-4a54f505afb4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.079560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9701-0411-41c9-acf1-845c5acf535e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.085476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.087185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.089104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.089571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.091262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:36.094842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:36.142750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 857/1710] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:35 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:36.143859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:36.163528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d1fc-368a-4eb2-82db-6419a63c9c8e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.190645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.190645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.190645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.190645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.191111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:36.192197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885fca-6ba0-40db-b3c0-1b326542a2be admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:36.217923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 858/1711] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:36.217923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711a53-5871-4bc3-9719-43b4856866ea None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.217923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711a53-5871-4bc3-9719-43b4856866ea None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.217923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711a53-5871-4bc3-9719-43b4856866ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.272259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.276697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.277239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.278220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.283662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:36.331001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:36.332893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:36.367027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 854/1712] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:36.369879 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:36.385325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a7711a53-5871-4bc3-9719-43b4856866ea None None] MFA Rules not processed for user `9d341bba8dda445ca4eac6d52aa9f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:36.388758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a7711a53-5871-4bc3-9719-43b4856866ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:36.405508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a5c88-395b-402c-8115-3ab2aed989dc service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.416406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.417047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.417327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.435983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.436827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:36.446931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:36.472427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 855/1713] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:36.472427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:36.511601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c06a57-3de9-4678-9423-4f2d768558b4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.539680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.541560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.542900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.545844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] PATH_INFO: `/v3/projects/7c30f7ddebf549d5a9e2443df60f5841/users/adaf5541b36246fca916491a209de27e/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.549979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c30f7ddebf549d5a9e2443df60f5841, user_id=adaf5541b36246fca916491a209de27e, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:36.552611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:36.615212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 856/1714] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:36 2022] PUT /identity/v3/projects/7c30f7ddebf549d5a9e2443df60f5841/users/adaf5541b36246fca916491a209de27e/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:36.645215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:36.702089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 859/1715] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:36.705160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695d59-1881-490b-8128-844fc001c6aa None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.711026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695d59-1881-490b-8128-844fc001c6aa None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.711494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695d59-1881-490b-8128-844fc001c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:36.819666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f2695d59-1881-490b-8128-844fc001c6aa None None] MFA Rules not processed for user `1a343996462b462d86fb89b876f4e127`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:36.821212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f2695d59-1881-490b-8128-844fc001c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:36.853063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:36.870863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17a71-44b7-41b3-8a15-e7026a9b0c27 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:36.938276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:36.944700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:36.945932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:36.950205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] PATH_INFO: `/v3/projects/c39b643095c743bbbafc239e10224ed6/users/308aa5960b054efe81335883f41e9d73/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.020378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 860/1716] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:37.029715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068176af-c84e-4029-9867-4c089966dbaa None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.029715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068176af-c84e-4029-9867-4c089966dbaa None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.029715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068176af-c84e-4029-9867-4c089966dbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.038707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39b643095c743bbbafc239e10224ed6, user_id=308aa5960b054efe81335883f41e9d73, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:37.050955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56837b73-78f9-4a91-a2d2-2dc0d5639918 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:37.064232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:37.105900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 857/1717] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:36 2022] PUT /identity/v3/projects/c39b643095c743bbbafc239e10224ed6/users/308aa5960b054efe81335883f41e9d73/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:37.111327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.111623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.111903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.187126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-068176af-c84e-4029-9867-4c089966dbaa None None] MFA Rules not processed for user `adaf5541b36246fca916491a209de27e`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:37.188279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-068176af-c84e-4029-9867-4c089966dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:37.199956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] MFA Rules not processed for user `9d341bba8dda445ca4eac6d52aa9f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:37.223306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:37.486208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 858/1718] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:37.491629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:37.498301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:37.502869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 861/1719] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:37.503793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068176af-c84e-4029-9867-4c089966dbaa None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:37.656928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068176af-c84e-4029-9867-4c089966dbaa None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:37.666574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:37.667901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.668542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.668837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.670830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:37.674050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:37.680232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94e319-c858-495b-bb50-ae0e12c82a8f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:37.694983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:37.697142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.697439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.697727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.704510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 862/1720] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:37.706947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:37.711139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:37.748594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ec459-9724-4ddf-9a57-d245bab9e054 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:37.773888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:37.774665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.775481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.775773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.796279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:37.801884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:37.850529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 863/1721] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:37.851524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:37.858342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:37.869946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:37.873015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:37.897062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 859/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:37.898170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:37.924145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa8973-ee9f-41f9-b8f7-42feb2bceece service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:37.929291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:37.930242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:37.930685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:37.931133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] PATH_INFO: `/v3/projects/c39b643095c743bbbafc239e10224ed6/users/308aa5960b054efe81335883f41e9d73/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:37.938167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39b643095c743bbbafc239e10224ed6, user_id=308aa5960b054efe81335883f41e9d73, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:37.946863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:37.947979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781126b-0727-4679-b70b-394067652ad0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:37.991769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 860/1723] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:37 2022] PUT /identity/v3/projects/c39b643095c743bbbafc239e10224ed6/users/308aa5960b054efe81335883f41e9d73/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:38.002669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.003034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.003316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.061140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c399-d7b3-4535-9a0c-210215c41bb8 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:38.076601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] MFA Rules not processed for user `308aa5960b054efe81335883f41e9d73`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:38.082033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:38.107373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:38.245644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:38.247608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.248203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.248558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.356109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 861/1724] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:38.366712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:38.368279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:38.406338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:38.407949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262447fc-fd02-4ea9-a937-a77e2dc09d12 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:38.410176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c65c-87f6-409b-9587-f5ca01cfd0be None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:38.415921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:38.416886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.417305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.418454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.420006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 864/1725] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:38.440761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:38.444786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e3872-0230-4af3-bcd9-74cdbb90fa3b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:38.485600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 862/1726] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:38.669918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672747-2f5c-4265-b205-5bda4836daf1 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.670493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672747-2f5c-4265-b205-5bda4836daf1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.670994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672747-2f5c-4265-b205-5bda4836daf1 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.672580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 865/1727] 10.222.0.60 () {54 vars in 912 bytes} [Fri Jul 29 11:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:38.680434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647fe7-df29-4b8b-892c-6114992d214e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.681476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647fe7-df29-4b8b-892c-6114992d214e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.681985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647fe7-df29-4b8b-892c-6114992d214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.712646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-78647fe7-df29-4b8b-892c-6114992d214e None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:38.714219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78647fe7-df29-4b8b-892c-6114992d214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:38.835205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672747-2f5c-4265-b205-5bda4836daf1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:38.898192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 863/1728] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:38.914499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:38.915447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:38.916305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:38.963517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] MFA Rules not processed for user `ee3506015d9240258cbada860704dffe`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:38.967295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.066294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672747-2f5c-4265-b205-5bda4836daf1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:39.082238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:39.082727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.083014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.083291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] PATH_INFO: `/v3/users/21ef5c2a08554251ae71936bcefcdb4a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.084720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ef5c2a08554251ae71936bcefcdb4a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:39.086870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:39.166280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 864/1729] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:39.174980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:39.179813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:39.193206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.217181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ef5c2a08554251ae71936bcefcdb4a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.218202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ef5c2a08554251ae71936bcefcdb4a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.224474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6f46-9c1c-404a-aabb-2295541c0639 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:39.231596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:39.233256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ef5c2a08554251ae71936bcefcdb4a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.234833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ef5c2a08554251ae71936bcefcdb4a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.240275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.241653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.242564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.253244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.282631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-86f0775f-d124-4f1d-866c-093bfd4542f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ef5c2a08554251ae71936bcefcdb4a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.287534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:39.289450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:39.306922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 866/1730] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:38 2022] DELETE /identity/v3/users/21ef5c2a08554251ae71936bcefcdb4a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:39.309289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.309756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.311792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.318856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 865/1731] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:39.392672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:39.393960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.540007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 867/1732] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:39.586947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:39.588622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.632113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ae1c-b0b8-46eb-9c8f-a1d11115230e service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:39.638894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:39.640443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:39.661309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:39.664399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.664968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.673701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] PATH_INFO: `/v3/users/f0cde32605184fb7a440bb1567beb3e4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.675839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cde32605184fb7a440bb1567beb3e4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:39.681603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:39.791126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:39.814250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62c5a-8304-4103-9400-bb1df95eacd8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:39.821254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:39.821254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.821254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.821254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.838862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cde32605184fb7a440bb1567beb3e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.839876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cde32605184fb7a440bb1567beb3e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.848760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cde32605184fb7a440bb1567beb3e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.851167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:39.854184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3fbe-40ca-4e11-b594-c8825621b7ed service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:39.875299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cde32605184fb7a440bb1567beb3e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.876395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cde32605184fb7a440bb1567beb3e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:39.878475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 868/1733] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:39.923766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd2bd9-7cd5-4714-b96b-6ce28a4d0e10 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:39.924142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd2bd9-7cd5-4714-b96b-6ce28a4d0e10 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:39.924522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd2bd9-7cd5-4714-b96b-6ce28a4d0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:39.928149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 866/1734] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:39 2022] DELETE /identity/v3/users/f0cde32605184fb7a440bb1567beb3e4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:39.984825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cccd2bd9-7cd5-4714-b96b-6ce28a4d0e10 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:39.987191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cccd2bd9-7cd5-4714-b96b-6ce28a4d0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:40.141273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:40.179030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 869/1735] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:40.243291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:40.244892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:40.427865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba57ec2-6173-4286-bc51-d41a65a86588 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:40.438373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:40.440044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:40.441984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:40.442362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:40.481281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:40.486498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:40.518009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 867/1736] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:40.872443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:40.872730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:40.873025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:40.995120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:40.997938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:41.282210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 870/1737] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:41.688990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:41.691098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:41.936000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ad265-fade-4ece-9258-4f15f7591541 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:41.952885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:41.955828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:41.956150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:41.956434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:41.997402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:41.999331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:42.009519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:42.012293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:42.050514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 868/1738] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:46:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:46:42.062248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003045e5-3312-424b-9ad2-9084a5fd8342 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:42.082528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:42.085971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:42.086789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:42.090288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] PATH_INFO: `/v3/projects/a0161f92ef0a41a6a146dae85bd21bf9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:42.096043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0161f92ef0a41a6a146dae85bd21bf9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:42.118020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:42.274891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0161f92ef0a41a6a146dae85bd21bf9', 'request_id': 'req-f6b26847-b890-4ab5-8400-bc709bd32036'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.301199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0161f92ef0a41a6a146dae85bd21bf9', 'request_id': 'req-f6b26847-b890-4ab5-8400-bc709bd32036'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.338345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0161f92ef0a41a6a146dae85bd21bf9', 'request_id': 'req-f6b26847-b890-4ab5-8400-bc709bd32036'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.385377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] The token cache is being invalidate because project a0161f92ef0a41a6a146dae85bd21bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:42.390339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.394361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b26847-b890-4ab5-8400-bc709bd32036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.400145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 871/1739] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:42 2022] DELETE /identity/v3/projects/a0161f92ef0a41a6a146dae85bd21bf9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:42.407229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:42.425138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2608cd-a9f9-4e39-af49-606eb62b255a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:42.425441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2608cd-a9f9-4e39-af49-606eb62b255a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:42.426344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2608cd-a9f9-4e39-af49-606eb62b255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:42.448395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33402b1d-f554-4966-83ee-0b8696084b18 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:42.540730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9a2608cd-a9f9-4e39-af49-606eb62b255a None None] MFA Rules not processed for user `9d341bba8dda445ca4eac6d52aa9f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:42.548189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9a2608cd-a9f9-4e39-af49-606eb62b255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:42.560976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:42.699107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:42.754226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 872/1740] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:42.756946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:42.757757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:42.758050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:42.758443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] PATH_INFO: `/v3/users/308aa5960b054efe81335883f41e9d73` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:42.760150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=308aa5960b054efe81335883f41e9d73)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:42.763736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:42.858865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:42.861176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:42.861176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:42.989937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308aa5960b054efe81335883f41e9d73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:42.990651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308aa5960b054efe81335883f41e9d73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.002314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] MFA Rules not processed for user `1a343996462b462d86fb89b876f4e127`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:43.009013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308aa5960b054efe81335883f41e9d73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.016910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:43.026492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308aa5960b054efe81335883f41e9d73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.027695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308aa5960b054efe81335883f41e9d73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.080528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 869/1741] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:42 2022] DELETE /identity/v3/users/308aa5960b054efe81335883f41e9d73 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:43.081195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:43.086754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:43.322790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 873/1742] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:43.371966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d8324-315b-4569-a3ea-d759ee4dad8a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:43.400542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:43.401309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:43.401688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:43.402114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] PATH_INFO: `/v3/projects/99ead974f26c41dcbd2cb25140acb05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:43.410177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ead974f26c41dcbd2cb25140acb05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:43.412369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:43.567716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:43.593256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ead974f26c41dcbd2cb25140acb05d', 'request_id': 'req-92fe9f0b-3087-4e90-9f45-bc269f852dd1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.614476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ead974f26c41dcbd2cb25140acb05d', 'request_id': 'req-92fe9f0b-3087-4e90-9f45-bc269f852dd1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.657693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ead974f26c41dcbd2cb25140acb05d', 'request_id': 'req-92fe9f0b-3087-4e90-9f45-bc269f852dd1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.708797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] The token cache is being invalidate because project 99ead974f26c41dcbd2cb25140acb05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:43.709341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.710493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:43.716440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 870/1743] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:43 2022] DELETE /identity/v3/projects/99ead974f26c41dcbd2cb25140acb05d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:43.717210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:43.754315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e4a7e-c3cd-4d82-b041-8d48f46f0f75 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:44.212225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:44.213695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:44.239291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:44.240346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:44.240785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:44.241208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] PATH_INFO: `/v3/users/adaf5541b36246fca916491a209de27e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:44.243541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaf5541b36246fca916491a209de27e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:44.253849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:44.411695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaf5541b36246fca916491a209de27e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:44.414395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaf5541b36246fca916491a209de27e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:44.438976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaf5541b36246fca916491a209de27e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:44.444427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaf5541b36246fca916491a209de27e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:44.482224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaf5541b36246fca916491a209de27e'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:44.536169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 874/1744] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:43 2022] DELETE /identity/v3/users/adaf5541b36246fca916491a209de27e => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:44.537452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:44.545853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:44.640012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:44.800261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe9f0b-3087-4e90-9f45-bc269f852dd1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:44.930281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adae10-0f9c-4bf5-8aa2-2f8b49b6e408 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:44.959166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:44.961560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:44.961901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:44.966686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] PATH_INFO: `/v3/users/33f9e49f133043f7a61a5e2a9d18759f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:44.973166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f9e49f133043f7a61a5e2a9d18759f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:44.985357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:45.013922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:45.016933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.017353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.017818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] PATH_INFO: `/v3/projects/c39b643095c743bbbafc239e10224ed6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.022799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39b643095c743bbbafc239e10224ed6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:45.025800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:45.143877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f9e49f133043f7a61a5e2a9d18759f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.146835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f9e49f133043f7a61a5e2a9d18759f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.164432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f9e49f133043f7a61a5e2a9d18759f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.165402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f9e49f133043f7a61a5e2a9d18759f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.227970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b7f1e8f8-2439-4fd8-8395-63852188cc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f9e49f133043f7a61a5e2a9d18759f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.278157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 875/1745] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:44 2022] DELETE /identity/v3/users/33f9e49f133043f7a61a5e2a9d18759f => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:45.283833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.284135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.290019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.304996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39b643095c743bbbafc239e10224ed6', 'request_id': 'req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.324389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39b643095c743bbbafc239e10224ed6', 'request_id': 'req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.338397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39b643095c743bbbafc239e10224ed6', 'request_id': 'req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.365679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:45.375547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:45.391678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] The token cache is being invalidate because project c39b643095c743bbbafc239e10224ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:45.391678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.391678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4e0ad39-cf6f-43e4-8d39-8044fcbe059b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:45.391678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 871/1746] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:44 2022] DELETE /identity/v3/projects/c39b643095c743bbbafc239e10224ed6 => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:45.394825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c544b-4b16-447f-88d6-ab8af2f5549e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.397625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c544b-4b16-447f-88d6-ab8af2f5549e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.398022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c544b-4b16-447f-88d6-ab8af2f5549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.436837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:45.466047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d44c544b-4b16-447f-88d6-ab8af2f5549e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:45.476240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d44c544b-4b16-447f-88d6-ab8af2f5549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:45.585593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 876/1747] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:45.601314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:45.603898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:45.742428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:45.796076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 872/1748] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:45.804489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.805466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.806115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.825405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bedabb-9be9-4304-9c1f-29a77f589f57 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:45.844360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:45.847709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:45.861784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:45.862999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.863433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.864026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.875830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 873/1749] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:45.880319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:45.916490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f38e-97c9-4c66-ad13-fdf5d50826be None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:45.920505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:45.922423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:45.938198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:45.939009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:45.943251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:45.944492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:45.947891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:45.951024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:45.952819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:45.954789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 877/1750] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:46.023681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:46.024232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 874/1751] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:46.036830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ece15-d097-4dd4-b8aa-561c941996a8 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:46.065788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:46.067425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:46.068341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:46.070412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:46.075201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:46.084871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:46.161735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 878/1752] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:46 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:46.162932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:46.178004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7756-731b-4b4d-8f2e-8f842409288e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:46.530623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:46.538787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:46.574267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:46.582034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:46.583155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:46.584239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:46.591951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:46.596786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:46.727789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 875/1753] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:46 2022] POST /identity/v3/users => generated 292 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:46.728801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:46.788098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0aacf-adc5-4a34-89f1-580e47d2825b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:46.806583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:46.810149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:46.810454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:46.810734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:46.811471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:46.813100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:46.870248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 876/1754] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:46.887321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164271e-59bc-49c8-bbf1-f602ce23f592 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:46.890820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:46.926072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:46.926869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:46.927173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:46.927523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] PATH_INFO: `/v3/users/59152ef62412462f82699acf54c5b833` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:46.928873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59152ef62412462f82699acf54c5b833)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:46.930294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f7c3-8785-410f-a889-4d8b6ab2b7a7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:46.931077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:46.970135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:46.972460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:46.972809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:46.973086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:46.976350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:46.985749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:47.029689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 877/1755] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:47.032976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:47.033122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59152ef62412462f82699acf54c5b833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.034539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59152ef62412462f82699acf54c5b833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.063837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59152ef62412462f82699acf54c5b833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.064716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59152ef62412462f82699acf54c5b833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.070969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347a75-6b3f-469c-a47f-a718261c40de admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:47.091397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:47.094096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:47.094356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:47.094608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] PATH_INFO: `/v3/projects/af4d76b959be4fb794cf6d1145481d18/users/94c11c1cb1d448768e39b6ba25924c8d/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:47.115467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6b67b50-1f2d-4afa-a0b5-17e1873572b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59152ef62412462f82699acf54c5b833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.151393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4d76b959be4fb794cf6d1145481d18, user_id=94c11c1cb1d448768e39b6ba25924c8d, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:47.160143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ff57-a163-48fd-bd3e-3c27e1b983f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:47.169965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 879/1756] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:46 2022] DELETE /identity/v3/users/59152ef62412462f82699acf54c5b833 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:47.175589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa973e4-394f-485f-bc54-c8b8aec9501c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:47.175866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa973e4-394f-485f-bc54-c8b8aec9501c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:47.176424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa973e4-394f-485f-bc54-c8b8aec9501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:47.218270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 878/1757] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:47 2022] PUT /identity/v3/projects/af4d76b959be4fb794cf6d1145481d18/users/94c11c1cb1d448768e39b6ba25924c8d/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:47.220889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:47.221179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:47.221467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:47.303719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6aa973e4-394f-485f-bc54-c8b8aec9501c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:47.305034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6aa973e4-394f-485f-bc54-c8b8aec9501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:47.404163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] MFA Rules not processed for user `94c11c1cb1d448768e39b6ba25924c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:47.439948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:47.455554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:47.544990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 880/1758] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:47.546381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:47.546768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:47.546956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:47.553547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:47.587314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:47.589618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:47.765446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 881/1759] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 29 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:47.766488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:47.772064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:47.802854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a540-ae2a-45fd-b6b5-918a5b758c3c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:47.819655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:47.820632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:47.821037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:47.821502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] PATH_INFO: `/v3/projects/7c30f7ddebf549d5a9e2443df60f5841` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:47.826511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c30f7ddebf549d5a9e2443df60f5841)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:47.831968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:47.923075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 879/1760] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 702 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:47.924756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:47.931317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:47.960756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c30f7ddebf549d5a9e2443df60f5841', 'request_id': 'req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.972085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c30f7ddebf549d5a9e2443df60f5841', 'request_id': 'req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:47.974818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1518b-a327-44cd-9575-4a0bbb95f76f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:47.991505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c30f7ddebf549d5a9e2443df60f5841', 'request_id': 'req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:48.024676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] The token cache is being invalidate because project 7c30f7ddebf549d5a9e2443df60f5841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:48.025496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:48.028079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:48.036814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 882/1761] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:47 2022] DELETE /identity/v3/projects/7c30f7ddebf549d5a9e2443df60f5841 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:48.040502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.044850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.139904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2757-92b6-4943-bd07-6e1ad2fa1502 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.144835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.145708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.146101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.146388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.148376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.161019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.161703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.161980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.162254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.162367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.164070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.171168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.177711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 883/1762] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:48.177711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.179350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.196514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:48.297747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a81e38-ff9a-4816-93d1-da11ae0da4b8 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.317376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.318927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.319368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.320325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.322469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.325961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ccf06-09fe-465e-9e41-e72cb95ed8e4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.368360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.371178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.397280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 884/1763] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:48 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:48.398686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25021f8-8356-4574-a768-50abc96170c1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.399014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25021f8-8356-4574-a768-50abc96170c1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.399543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25021f8-8356-4574-a768-50abc96170c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.402634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 880/1764] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:48.403747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.429298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ce4d-ed73-4a79-9c6d-77229209bf1f service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.446784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a25021f8-8356-4574-a768-50abc96170c1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:48.448239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a25021f8-8356-4574-a768-50abc96170c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.611436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.612627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.612913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.613190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.618528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.624963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.649754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:48.663663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 881/1765] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:48 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:48.665206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.679192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134e37d-d791-4958-b59d-d5c800a32cbd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.683418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 885/1766] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:48.694589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.694990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.695226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.720449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.721874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.722674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.723355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.724543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.727393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.749273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 882/1767] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:48.750330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.780678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:48.781991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:48.790180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b95-6163-4029-a8ca-552acbf0aa88 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.812956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.816602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.817001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.817283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] PATH_INFO: `/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c/users/e1e838e291e447e097836b161867de09/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.825879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 886/1768] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:48.826935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.861128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473f82-630d-4ebb-b5ee-3c1a5d8ba193 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:48.875266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:48.875916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:48.876194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:48.876466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:48.877585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ff2d02cad4b25b88ea28b73b63a8c, user_id=e1e838e291e447e097836b161867de09, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.879076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:48.879708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:48.882404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.887078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:48.953042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 883/1770] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:48 2022] PUT /identity/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c/users/e1e838e291e447e097836b161867de09/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:48.953740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 887/1770] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:48.957916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.958792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:48.994228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f8ba-accd-4b05-b961-f2cce1aaa4ba admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.150340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.151336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.152565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.153049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.153949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.155744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.171650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 888/1771] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:49.172969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:49.189040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2423-9987-4902-a640-cadc5005b881 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.196737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.197820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.198342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.199475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] PATH_INFO: `/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c/users/e1e838e291e447e097836b161867de09/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.203069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ff2d02cad4b25b88ea28b73b63a8c, user_id=e1e838e291e447e097836b161867de09, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.218572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c390dd-669a-4759-a14b-c05b77991857 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.218756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b28-7348-4068-8d62-a661acc269eb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.238842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.239585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.239870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.243965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.263242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.266978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.285770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 889/1772] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:49 2022] PUT /identity/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c/users/e1e838e291e447e097836b161867de09/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:49.287759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.288414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.288926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.309555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:49.376727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 884/1773] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:48 2022] POST /identity/v3/projects => generated 387 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:49.381389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:49.396714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] MFA Rules not processed for user `e1e838e291e447e097836b161867de09`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:49.403854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:49.634137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492d84-fee3-4b22-90b3-42dfce50f81d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.649936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.650748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.651139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.651903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.653366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.658326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.682602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 890/1774] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:49.692530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:49.693527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:49.732499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 885/1775] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:49 2022] POST /identity/v3/users => generated 294 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:49.737002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:49.785027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ba8-4adc-42ce-8d1b-6ec7db9fdb91 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.805860 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.808223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.809095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.809544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.813511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.819571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.865821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 886/1776] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:49.869748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:49.920467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b4ed-6fd8-4b3e-a340-79ec1f17f77b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.929161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84368-741c-45d9-9dd6-ec5614cec895 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:49.942754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.943412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.943695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.947567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.967732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:49.978411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:49.978851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:49.979493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:49.981007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.983384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.994475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:49.995973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:49.998757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 887/1777] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:50.012245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:50.025827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 891/1778] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:50.028618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:50.028985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.054536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a25c6-7e0d-4d5d-a249-859e22968ac8 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:50.055972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a65e1-a719-4943-a777-7dd773d4d13c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:50.086821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:50.087826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:50.088306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:50.088829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] PATH_INFO: `/v3/projects/68e0fa57c2ec45cf84ed77164ffabf91/users/3bdb786eb70044dabd560a6e71a45da3/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:50.091467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:50.092758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:50.094914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:50.095289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] PATH_INFO: `/v3/projects/7fa2e3e36e444bd7bca8712b9ea6eaae` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:50.100225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa2e3e36e444bd7bca8712b9ea6eaae)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:50.105307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:50.142653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:50.150524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e0fa57c2ec45cf84ed77164ffabf91, user_id=3bdb786eb70044dabd560a6e71a45da3, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:50.162221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2dab3-d220-48de-b6d0-76d03d0a9106 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:50.206409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 892/1779] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:50 2022] PUT /identity/v3/projects/68e0fa57c2ec45cf84ed77164ffabf91/users/3bdb786eb70044dabd560a6e71a45da3/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:50.228308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:50.228875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:50.229302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:50.249061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa2e3e36e444bd7bca8712b9ea6eaae', 'request_id': 'req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:50.281968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa2e3e36e444bd7bca8712b9ea6eaae', 'request_id': 'req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:50.297583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa2e3e36e444bd7bca8712b9ea6eaae', 'request_id': 'req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:50.334182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] The token cache is being invalidate because project 7fa2e3e36e444bd7bca8712b9ea6eaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:50.334947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:50.336085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:50.341873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 888/1780] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:49 2022] DELETE /identity/v3/projects/7fa2e3e36e444bd7bca8712b9ea6eaae => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:50.343482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:50.347167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.356244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] MFA Rules not processed for user `3bdb786eb70044dabd560a6e71a45da3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:50.358986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.487542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08c4a0-c3a2-495c-a581-393fe2a4caa0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:50.492952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:50.494726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:50.494726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:50.494726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:50.497502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.599389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:50.652696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 893/1781] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:50.658498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:50.660584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.754430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:50.758781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:50.798790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 889/1782] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:50.798790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:50.801929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:50.985236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6345c7-be12-4b9f-8a2e-4f5f2cc498cf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:50.999396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:51.004844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:51.005150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:51.005818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] PATH_INFO: `/v3/users/8df4b763da0744b68dac46e5211a0ee0` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:51.008378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df4b763da0744b68dac46e5211a0ee0)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:51.014855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:51.059526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:51.074902 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ebd3-f0f2-4294-b371-cac97ae19db2 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:51.102865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:51.104019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:51.106105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:51.106430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:51.107141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:51.133840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:51.203100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df4b763da0744b68dac46e5211a0ee0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:51.204543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df4b763da0744b68dac46e5211a0ee0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:51.222735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df4b763da0744b68dac46e5211a0ee0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:51.223882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df4b763da0744b68dac46e5211a0ee0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:51.232678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 890/1783] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:50 2022] POST /identity/v3/projects => generated 387 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:51.253602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:51.257763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:51.279058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df4b763da0744b68dac46e5211a0ee0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:51.303345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 894/1784] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:50 2022] DELETE /identity/v3/users/8df4b763da0744b68dac46e5211a0ee0 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:51.457274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8304-5452-460c-970c-e982e15ae33a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:51.619703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:51.620370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:51.620660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:51.620945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:51.621646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:51.630020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:51.689172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 891/1785] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:51 2022] POST /identity/v3/users => generated 300 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:51.690214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:51.721688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734ed8-ad3a-40f2-a25a-37893ffa5ea4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:51.740958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:51.743068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:51.744227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:51.746703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:51.749327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:51.754477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:51.781962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 895/1786] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:46:51.783689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:51.797444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7956d2-1be5-4796-b89d-c0d94689341e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:51.825160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:51.825985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:51.826414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:51.826613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] PATH_INFO: `/v3/projects/1e150e32b75d45eaba92b9888f417534/users/96d2eb06b5e44e7d85e62728447ec43d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:51.901117 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e150e32b75d45eaba92b9888f417534, user_id=96d2eb06b5e44e7d85e62728447ec43d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:51.907531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:51.959946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 892/1787] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:51 2022] PUT /identity/v3/projects/1e150e32b75d45eaba92b9888f417534/users/96d2eb06b5e44e7d85e62728447ec43d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:51.962171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:51.994320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304499-1edb-499c-802b-3e0a59adebea admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:52.260825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:52.262717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:52.263004 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:52.265406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:52.266220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:52.272582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046762e3-025b-46d3-957a-6e2b18f8f532 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:52.287342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:52.303890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 896/1788] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:52.307954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:52.324232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd8f1-fff8-4871-a0ff-86e165d0c786 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:52.343988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:52.344763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:52.345070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:52.345346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] PATH_INFO: `/v3/projects/1e150e32b75d45eaba92b9888f417534/users/96d2eb06b5e44e7d85e62728447ec43d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:52.354292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e150e32b75d45eaba92b9888f417534, user_id=96d2eb06b5e44e7d85e62728447ec43d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:52.371315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:52.433530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 893/1789] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:52 2022] PUT /identity/v3/projects/1e150e32b75d45eaba92b9888f417534/users/96d2eb06b5e44e7d85e62728447ec43d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:52.439987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:52.440750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:52.441160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:52.536429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] MFA Rules not processed for user `96d2eb06b5e44e7d85e62728447ec43d`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:52.542985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:52.852326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 897/1790] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:52.859143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:52.861107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:53.015788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:53.067739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547947ab-e5ac-4e7b-9ba9-9b259ab7d4ed admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:53.085095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:53.087639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:53.092568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:53.093402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:53.145209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:53.150660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf78f-3659-43b9-9f98-87962a021cdf service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:53.220033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 894/1791] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:53.364731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:53.472495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e323-71d0-4f8d-877e-bd34a7997799 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:53.479990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:53.480863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:53.481461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:53.481848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] PATH_INFO: `/v3/users/3bdb786eb70044dabd560a6e71a45da3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:53.483766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdb786eb70044dabd560a6e71a45da3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:53.486385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:53.577790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdb786eb70044dabd560a6e71a45da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:53.578621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdb786eb70044dabd560a6e71a45da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:53.597215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdb786eb70044dabd560a6e71a45da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:53.597215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdb786eb70044dabd560a6e71a45da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:53.631077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdb786eb70044dabd560a6e71a45da3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:53.674386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 898/1792] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:53 2022] DELETE /identity/v3/users/3bdb786eb70044dabd560a6e71a45da3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:53.676255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985979-2290-428f-aac6-07700ea0e9e3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:53.676774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985979-2290-428f-aac6-07700ea0e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:53.677122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985979-2290-428f-aac6-07700ea0e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:53.730336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5b985979-2290-428f-aac6-07700ea0e9e3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:53.731915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5b985979-2290-428f-aac6-07700ea0e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:53.921157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 895/1793] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:54.084405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:54.086559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:54.096212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:54.200254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8b81-74e9-49e5-9cf1-be2d2f4b47d0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:54.201857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8b81-74e9-49e5-9cf1-be2d2f4b47d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:54.202367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8b81-74e9-49e5-9cf1-be2d2f4b47d0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:54.205801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 896/1794] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:46:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:54.255915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0037-bf6f-490a-9d4c-e69fdea5032f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:54.265531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:54.266356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:54.268641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:54.268771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:54.302351 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:54.303984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:54.326047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 899/1795] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:54.396225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:54.396509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:54.396971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:54.422000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:54.423648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:54.646533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 897/1796] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:54.650127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:54.655821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:54.673564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:54.675871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:54.703559 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe9f0-62d0-4dff-8e9e-fee0b06d5f7e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:54.720985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:54.720985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:54.720985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:54.720985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] PATH_INFO: `/v3/users/94c11c1cb1d448768e39b6ba25924c8d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:54.722325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c11c1cb1d448768e39b6ba25924c8d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:54.724350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:54.732948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f4254-ece2-4199-b566-25896e7556dc service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:54.750237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:54.751338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:54.751815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:54.752447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] PATH_INFO: `/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:54.755169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64102500ee934a5abcdb4ff2a40c5b8b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:54.757626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:54.841240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c11c1cb1d448768e39b6ba25924c8d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.842642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c11c1cb1d448768e39b6ba25924c8d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.858231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c11c1cb1d448768e39b6ba25924c8d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.889357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c11c1cb1d448768e39b6ba25924c8d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.890250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c11c1cb1d448768e39b6ba25924c8d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.898412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:54.920122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 898/1797] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:54 2022] DELETE /identity/v3/users/94c11c1cb1d448768e39b6ba25924c8d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:54.923866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:54.930546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:54.945961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64102500ee934a5abcdb4ff2a40c5b8b', 'request_id': 'req-0b5c4e04-676a-4307-aa35-6c128f6e63c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.960278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64102500ee934a5abcdb4ff2a40c5b8b', 'request_id': 'req-0b5c4e04-676a-4307-aa35-6c128f6e63c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:54.981707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64102500ee934a5abcdb4ff2a40c5b8b', 'request_id': 'req-0b5c4e04-676a-4307-aa35-6c128f6e63c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.016492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] The token cache is being invalidate because project 64102500ee934a5abcdb4ff2a40c5b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:55.018926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.021169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0b5c4e04-676a-4307-aa35-6c128f6e63c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.026073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 900/1798] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:54 2022] DELETE /identity/v3/projects/64102500ee934a5abcdb4ff2a40c5b8b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:55.027871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.034904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.036063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.091471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:55.098894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.102440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7ffe-7bf1-403a-98d3-f2cc0479e535 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:55.112228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:55.112878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.113159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.113465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.115280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.146935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:55.148575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1e101-229b-4775-a0b3-346cd5ff8852 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:55.185836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 899/1799] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:55.187332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901341-1c25-4f7a-8695-c3e12e30adf0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.187656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901341-1c25-4f7a-8695-c3e12e30adf0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.187922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901341-1c25-4f7a-8695-c3e12e30adf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.228899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 901/1800] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:55.243709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ff901341-1c25-4f7a-8695-c3e12e30adf0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:55.245887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff901341-1c25-4f7a-8695-c3e12e30adf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.267940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 900/1801] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:55.269233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.278490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.278588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.278588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.278588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.322358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:55.324232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.375951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 901/1802] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:55.379700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.431229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868884c-bf33-4cfe-91d2-0c296f4ea49d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:55.449571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:55.450423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.450711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.450984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.451978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:46:55.452169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:55.453906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:55.466118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:55.497473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 902/1803] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:46:55.502057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.511263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:55.556178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ebe9a-cbee-4313-8617-bc4c965ef3a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:55.559322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498bcb2-1fdc-4267-b6a2-6a02fce317d0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:55.566631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:55.567594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.568031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.569346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.578619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:55.579478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.579768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.580116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] PATH_INFO: `/v3/projects/1ff908d615634070a538b80f0530879e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.581938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff908d615634070a538b80f0530879e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:55.585148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:55.597207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:55.598821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:55.615245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 902/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:55.616445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.635466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f792c5-3494-40f6-b96a-9c8242118a1d service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:55.658128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:55.660218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:55.660984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:55.661585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:55.662883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:55.664954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:55.726503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 903/1805] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:55 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:55.726815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff908d615634070a538b80f0530879e', 'request_id': 'req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.731653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.743243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff908d615634070a538b80f0530879e', 'request_id': 'req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.771980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff908d615634070a538b80f0530879e', 'request_id': 'req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.811940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] The token cache is being invalidate because project 1ff908d615634070a538b80f0530879e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:55.812277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.813053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:55.816058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 903/1806] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:55 2022] DELETE /identity/v3/projects/1ff908d615634070a538b80f0530879e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:55.820727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:55.847676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:56.022225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:56.027731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8fe9e-20f4-41b8-8eae-8c86ce244920 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.043112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.043840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.044129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.044407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.048644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.052468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.118801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 904/1807] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:55 2022] POST /identity/v3/users => generated 284 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:56.121183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4a9d4-c090-4831-b13b-c17fdcf29bcd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.122747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:56.125887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:56.135794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.142690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.143808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.143925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] PATH_INFO: `/v3/users/eaaca8262b6842fc857c0a4e0b36d5e4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.153207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaca8262b6842fc857c0a4e0b36d5e4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.155263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.156837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32636d69-0ca2-4af5-9c02-338b33ea0669 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.171458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.172102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.172494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.172771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.173566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.178662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.217880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 905/1808] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:56.225780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:56.271682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0408cc2-b627-4e96-95d2-aee9711ef317 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.273037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaca8262b6842fc857c0a4e0b36d5e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:56.273992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaca8262b6842fc857c0a4e0b36d5e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:56.298445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaca8262b6842fc857c0a4e0b36d5e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:56.302614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.310109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.310745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.310873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.311789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.315037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaca8262b6842fc857c0a4e0b36d5e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:56.315676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15ee8ffd-adaa-4581-a668-af54962cf128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaca8262b6842fc857c0a4e0b36d5e4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:56.318937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.365531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 906/1809] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:56.367438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:56.370963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:56.389989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55d11-2f65-4dc3-939e-41d95985abc6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.395482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.396509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.397172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.397708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] PATH_INFO: `/v3/projects/eca7a91bb91b4fc2b35f70456ad6cac0/users/4fc0ff898c8048ac8095bdf82ba986a5/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.403622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 904/1810] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:55 2022] DELETE /identity/v3/users/eaaca8262b6842fc857c0a4e0b36d5e4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:56.422266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca7a91bb91b4fc2b35f70456ad6cac0, user_id=4fc0ff898c8048ac8095bdf82ba986a5, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.425673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.466881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 907/1811] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:56 2022] PUT /identity/v3/projects/eca7a91bb91b4fc2b35f70456ad6cac0/users/4fc0ff898c8048ac8095bdf82ba986a5/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:56.467460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.467757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.468045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.527416 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] MFA Rules not processed for user `4fc0ff898c8048ac8095bdf82ba986a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:56.528522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:56.713472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 905/1812] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:46:56.718298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:56.760908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:56.762774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:56.890912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:56.918887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:56.933386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf3dc-0ae3-478a-9f29-b18b239f5bbe admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.948256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.955551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.955928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.956209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.967219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:56.971873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fbb32-4e89-4c9b-8e69-cc04066e3f0b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:56.972979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:56.984229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:56.989991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:56.990297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:56.991958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] PATH_INFO: `/v3/projects/68e0fa57c2ec45cf84ed77164ffabf91` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:56.997564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e0fa57c2ec45cf84ed77164ffabf91)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:57.005976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:57.059191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 908/1813] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:46:56 2022] POST /identity/v3/projects => generated 367 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:57.061107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:57.158573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e0fa57c2ec45cf84ed77164ffabf91', 'request_id': 'req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.185040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e0fa57c2ec45cf84ed77164ffabf91', 'request_id': 'req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.215470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e0fa57c2ec45cf84ed77164ffabf91', 'request_id': 'req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.238759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] The token cache is being invalidate because project 68e0fa57c2ec45cf84ed77164ffabf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:57.240080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.240990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.249098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 906/1814] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:56 2022] DELETE /identity/v3/projects/68e0fa57c2ec45cf84ed77164ffabf91 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:57.250132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:57.254536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:57.268551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84a3e-8983-4290-9472-e6bf0a300ae8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:57.418763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b793e-b6e0-4fed-9a85-b3dac1481e8b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:57.445480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:57.446632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:57.453738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:57.454152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] PATH_INFO: `/v3/users/96d2eb06b5e44e7d85e62728447ec43d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:57.460423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d2eb06b5e44e7d85e62728447ec43d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:57.468524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:57.523956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:57.524624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:57.524910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:57.525190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:57.525900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:57.546558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:57.630674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 909/1815] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:46:57 2022] POST /identity/v3/users => generated 290 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:46:57.635458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:57.645312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:57.646490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d2eb06b5e44e7d85e62728447ec43d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.649513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d2eb06b5e44e7d85e62728447ec43d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.679307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d2eb06b5e44e7d85e62728447ec43d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.697333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d2eb06b5e44e7d85e62728447ec43d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.698212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d2eb06b5e44e7d85e62728447ec43d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:57.706190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec2f99-541d-4e47-9a3c-2df183cff5c6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:57.711076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:57.722618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:57.723312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:57.724017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:57.724017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:57.724634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:57.732049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:57.757762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 907/1816] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:57 2022] DELETE /identity/v3/users/96d2eb06b5e44e7d85e62728447ec43d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:57.762463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 910/1817] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:46:57.764307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:57.768289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:57.868628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8149ac-3fad-4678-8c59-529391db4778 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:57.874830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:57.875546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:57.875823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:57.876095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] PATH_INFO: `/v3/projects/6fa63b33c9004833a16ff15fbce1331d/users/ea2e78d2447c49eb94b0f45757ab51e7/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:57.896084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa63b33c9004833a16ff15fbce1331d, user_id=ea2e78d2447c49eb94b0f45757ab51e7, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:57.899505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:57.918363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 908/1818] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:57 2022] PUT /identity/v3/projects/6fa63b33c9004833a16ff15fbce1331d/users/ea2e78d2447c49eb94b0f45757ab51e7/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:57.922457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:57.933005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc565a-ba99-46c2-a9a6-97baa899c815 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:58.024843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:58.025992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.025992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.026868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.027537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:58.030088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d520d-a665-40b4-a6f3-ea279d2a8ba4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:58.043182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 911/1819] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:46:58.047202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:58.062619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61ed9-e62c-438f-b731-39be026c04c6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:58.069717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:58.070570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.071038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.071426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] PATH_INFO: `/v3/projects/6fa63b33c9004833a16ff15fbce1331d/users/ea2e78d2447c49eb94b0f45757ab51e7/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.074350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa63b33c9004833a16ff15fbce1331d, user_id=ea2e78d2447c49eb94b0f45757ab51e7, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:58.078018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:58.096429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 909/1820] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:46:58 2022] PUT /identity/v3/projects/6fa63b33c9004833a16ff15fbce1331d/users/ea2e78d2447c49eb94b0f45757ab51e7/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:58.109825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.110189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.110532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.118792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.144023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:58.148114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.164884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] MFA Rules not processed for user `ea2e78d2447c49eb94b0f45757ab51e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:58.166401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.333031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e155-9845-4c92-b783-094832af2b42 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:58.339941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:58.340837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.341265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.341815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] PATH_INFO: `/v3/projects/af4d76b959be4fb794cf6d1145481d18` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.343188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4d76b959be4fb794cf6d1145481d18)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:58.345497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:58.363996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 912/1821] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:58.377921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:58.388295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.470533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4d76b959be4fb794cf6d1145481d18', 'request_id': 'req-05990936-0e43-472e-9ce0-a1ae0fc20059'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.523968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4d76b959be4fb794cf6d1145481d18', 'request_id': 'req-05990936-0e43-472e-9ce0-a1ae0fc20059'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.531917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55328ab-9efd-452e-bd05-a76ba175b0a9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:58.534926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.548804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4d76b959be4fb794cf6d1145481d18', 'request_id': 'req-05990936-0e43-472e-9ce0-a1ae0fc20059'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.577399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] The token cache is being invalidate because project af4d76b959be4fb794cf6d1145481d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:58.581317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.582239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-05990936-0e43-472e-9ce0-a1ae0fc20059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.593514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 910/1822] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:58 2022] DELETE /identity/v3/projects/af4d76b959be4fb794cf6d1145481d18 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:46:58.597866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.598161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.598450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.609454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 911/1823] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:46:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:46:58.610405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:58.617161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.640181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:58.641221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.641878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.642363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.644738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.754900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289d359-6b6d-43f9-9094-0f55f3c18294 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:58.761656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:58.763464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.764034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.764892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.766082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] PATH_INFO: `/v3/users/e1e838e291e447e097836b161867de09` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.768220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e838e291e447e097836b161867de09)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:58.768830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:58.770779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee3e8-0a28-4299-804b-05152fc00a30 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:58.772132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:58.797737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 913/1824] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:46:58.800280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:58.801976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:58.801976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:58.865649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:58.867077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:58.870908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e838e291e447e097836b161867de09'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.872237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e838e291e447e097836b161867de09'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.883539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e838e291e447e097836b161867de09'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.893668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e838e291e447e097836b161867de09'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.895330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e838e291e447e097836b161867de09'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:58.943811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 912/1825] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:46:58 2022] DELETE /identity/v3/users/e1e838e291e447e097836b161867de09 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:58.944638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:58.947779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.006011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 914/1826] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:46:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:59.007170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:59.013911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.049644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7633b-dd8c-4495-b3d1-a4370b8d95dc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:59.121218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b143-2464-45a1-83e1-d09410832e78 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:59.127052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:59.127747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.128061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.128345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] PATH_INFO: `/v3/projects/c8ea867386ab4a13b2a10bf309366075` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.129582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ea867386ab4a13b2a10bf309366075)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:59.131686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:59.146690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:59.202704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:59.203413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.204188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.204301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.206436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.258905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ea867386ab4a13b2a10bf309366075', 'request_id': 'req-619101e0-7afd-4edb-b4f8-a51952a8bc0b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.272163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ea867386ab4a13b2a10bf309366075', 'request_id': 'req-619101e0-7afd-4edb-b4f8-a51952a8bc0b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.281357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ea867386ab4a13b2a10bf309366075', 'request_id': 'req-619101e0-7afd-4edb-b4f8-a51952a8bc0b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.301029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] The token cache is being invalidate because project c8ea867386ab4a13b2a10bf309366075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:59.301630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.302442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.304604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 913/1827] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:58 2022] DELETE /identity/v3/projects/c8ea867386ab4a13b2a10bf309366075 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:59.305946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:59.307803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.374484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:59.377710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:59.429947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 915/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:59.430858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:59.442475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.470854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619101e0-7afd-4edb-b4f8-a51952a8bc0b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:59.484122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:59.485227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.486899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.488709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] PATH_INFO: `/v3/projects/1e150e32b75d45eaba92b9888f417534` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.492014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e150e32b75d45eaba92b9888f417534)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:59.497057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:59.602111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:59.622991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e150e32b75d45eaba92b9888f417534', 'request_id': 'req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.636333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e150e32b75d45eaba92b9888f417534', 'request_id': 'req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.654553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e150e32b75d45eaba92b9888f417534', 'request_id': 'req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.679089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] The token cache is being invalidate because project 1e150e32b75d45eaba92b9888f417534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:46:59.679564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.680304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff2d5d2-bb0e-4898-90d6-bd87b1c63665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:46:59.683782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 914/1829] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:59 2022] DELETE /identity/v3/projects/1e150e32b75d45eaba92b9888f417534 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:46:59.685209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.685541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.685819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.690925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429045-ca88-44f8-bdd2-da423705b35e service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:59.756068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:59.757343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.815844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:59.868436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:59.869448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.871911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.872014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.874855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.890363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 915/1830] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:46:59.891659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:46:59.893195 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:46:59.907071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:59.911268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec4f0-61d0-4c4e-8812-e622eb16f0f6 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:59.914718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4cfb-bea4-4c1b-a04c-c60f80eccca5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:46:59.923588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:46:59.924838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.925309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.925802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] PATH_INFO: `/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.927562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602ff2d02cad4b25b88ea28b73b63a8c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:46:59.929816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:46:59.930796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 916/1831] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:46:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:46:59.933865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec267-07fe-47de-be44-089caf6bd366 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:46:59.934409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec267-07fe-47de-be44-089caf6bd366 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:46:59.936226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec267-07fe-47de-be44-089caf6bd366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:46:59.982057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cc4ec267-07fe-47de-be44-089caf6bd366 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:46:59.983449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cc4ec267-07fe-47de-be44-089caf6bd366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:00.002168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 917/1832] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:00.003752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52e5f1-6494-43fc-bf1e-a1998fee4141 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.004041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52e5f1-6494-43fc-bf1e-a1998fee4141 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.004375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52e5f1-6494-43fc-bf1e-a1998fee4141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.033973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-be52e5f1-6494-43fc-bf1e-a1998fee4141 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:00.035418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-be52e5f1-6494-43fc-bf1e-a1998fee4141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:00.061825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602ff2d02cad4b25b88ea28b73b63a8c', 'request_id': 'req-5c427a0c-8363-46f3-a68a-52f3233a1ac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:00.068546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602ff2d02cad4b25b88ea28b73b63a8c', 'request_id': 'req-5c427a0c-8363-46f3-a68a-52f3233a1ac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:00.083723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602ff2d02cad4b25b88ea28b73b63a8c', 'request_id': 'req-5c427a0c-8363-46f3-a68a-52f3233a1ac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:00.116015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] The token cache is being invalidate because project 602ff2d02cad4b25b88ea28b73b63a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:00.116298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:00.119285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c427a0c-8363-46f3-a68a-52f3233a1ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:00.121547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 916/1833] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:46:59 2022] DELETE /identity/v3/projects/602ff2d02cad4b25b88ea28b73b63a8c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:00.122739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf219-73f4-4558-bf15-deeaada1f855 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.123031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf219-73f4-4558-bf15-deeaada1f855 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.123312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf219-73f4-4558-bf15-deeaada1f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.126737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 918/1834] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:00.128450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.128678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.128974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.154228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:00.155776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:00.168594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-514bf219-73f4-4558-bf15-deeaada1f855 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:00.168864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 919/1835] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:00.170002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.171467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-514bf219-73f4-4558-bf15-deeaada1f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:00.186885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a6fe-328c-483b-8973-01890b51183c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.194623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.195574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.196837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.197364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.199173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:00.199707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.202169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.214412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 917/1836] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:00.214412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.214412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.214412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.232836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 920/1837] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:00.236573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.260092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bce2-8314-40ad-8181-41adff83305f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.263536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:00.264770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:00.266677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.267492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.267877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.268252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.269927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:00.270447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.273127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.286191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 918/1838] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:00.287028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.300327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 921/1839] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:00.300327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.300624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058c8a-443b-410a-b9e9-0eaffefe49ef None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.304396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.305035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.305728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.305728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.307016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.309628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.314671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c151c5-88d3-4a91-995f-f7116bd51aed admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.320946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.321728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.322078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.322637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.323910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:00.324334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.326129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.340147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 922/1840] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:00.342441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.348891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 919/1841] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.349759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.360957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da2a0-8691-46a7-8a7b-c6928403a1c5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.371362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:00.434619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5205e-554b-47ab-b920-44125720b097 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.436847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.437689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.438025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.438404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.439416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.440640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.441378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.441605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.441881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.442310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.443722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.445714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.474446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:00.481891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 920/1842] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.483025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.487795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 923/1843] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.489026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.574636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9cd7-a248-4298-b667-1cc732a000a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.580380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55642121-934e-4492-a724-fb2553008071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.581051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55642121-934e-4492-a724-fb2553008071 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.581835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55642121-934e-4492-a724-fb2553008071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.582120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55642121-934e-4492-a724-fb2553008071 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.582805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55642121-934e-4492-a724-fb2553008071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.584131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418355f-649b-4ae8-a7d5-203cf33960e9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.584938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55642121-934e-4492-a724-fb2553008071 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.590071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.590857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.591301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.591684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.592450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.594652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.614228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 921/1844] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.614228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55642121-934e-4492-a724-fb2553008071 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.625181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 924/1845] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.625181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.632139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55642121-934e-4492-a724-fb2553008071 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.638506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.639364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.639854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.640399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.641218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.643605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.655343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e733250-7c31-45b0-a9ac-26f0eb3cafc8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.660703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.661964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.661964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.662317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.662917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.664639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.679835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 925/1846] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.679835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.693646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3c2-2014-4182-a76a-b17e87fd9349 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.696759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 922/1847] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:00 2022] POST /identity/v3/users => generated 296 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:00.699317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.702513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.703465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.703756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.704090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.704886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.706655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.716831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6013cd-4839-49e9-9ee2-c34aca196801 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.724115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.724921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 926/1848] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.727929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.727929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.727929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.727929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.728770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.730607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.742359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a3b2-5db6-4f21-b8b1-15621b0b968e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.747630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 923/1849] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.747630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.752649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.753551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.754100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.754527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.755371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.757501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.761373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336250b-c51e-417b-a873-8b27a56f22f8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.767932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.769471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.769780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.770062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.770770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.772139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 927/1850] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.773126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.774953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.785106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94545-4102-487f-a5dd-a8fdca17f899 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.792462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.795636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 924/1851] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.795636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.799606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.800280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.801010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] PATH_INFO: `/v3/projects/df551fbeee984dc68407d586589dd4fd/users/0398bfeaaa4341298c6da23fffc13205/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.813143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9138f-ea9d-4241-bcc1-5fc5a2de03d4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.821514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:00.822155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:00.822757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:00.823598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:00.824401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.827970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.837937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df551fbeee984dc68407d586589dd4fd, user_id=0398bfeaaa4341298c6da23fffc13205, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:00.841546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:00.862922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 925/1852] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:00.868220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.889013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 928/1853] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:00 2022] PUT /identity/v3/projects/df551fbeee984dc68407d586589dd4fd/users/0398bfeaaa4341298c6da23fffc13205/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:00.889013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:00.896322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a569e2b-4b83-4ac4-81b4-adc1068841fd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:00.969990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:01.034212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:01.034904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.035179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.035459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] PATH_INFO: `/v3/projects/af5cbc35bd594c4fb92402fb6c3dc21e/users/e8f49c83a9044de78d1cf4fc603e0238/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.037085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95363d56-93f2-4784-b827-89acaa319797 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:01.044333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:01.045041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.045328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.045675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] PATH_INFO: `/v3/projects/49645294c85f4fe597115d938fbfa611/users/be61e665398a4443bc08843c1059d3de/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.067744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49645294c85f4fe597115d938fbfa611, user_id=be61e665398a4443bc08843c1059d3de, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:01.073047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432edee3-9637-46f8-aad5-c202ff6436e4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:01.081886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5cbc35bd594c4fb92402fb6c3dc21e, user_id=e8f49c83a9044de78d1cf4fc603e0238, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:01.085295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79f8db-a23d-4661-96f5-4e50b3e9c30b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:01.101497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 929/1854] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:00 2022] PUT /identity/v3/projects/49645294c85f4fe597115d938fbfa611/users/be61e665398a4443bc08843c1059d3de/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:01.103972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.105019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.105612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.116515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 926/1855] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:00 2022] PUT /identity/v3/projects/af5cbc35bd594c4fb92402fb6c3dc21e/users/e8f49c83a9044de78d1cf4fc603e0238/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:01.118116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0521e6-a090-4d79-833a-4cc2ee56200f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.120988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0521e6-a090-4d79-833a-4cc2ee56200f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.121468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0521e6-a090-4d79-833a-4cc2ee56200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.185924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] MFA Rules not processed for user `0398bfeaaa4341298c6da23fffc13205`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:01.187474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:01.233628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7b0521e6-a090-4d79-833a-4cc2ee56200f None None] MFA Rules not processed for user `be61e665398a4443bc08843c1059d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:01.235093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7b0521e6-a090-4d79-833a-4cc2ee56200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:01.270163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:01.367603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 927/1856] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:01.374449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.374856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.375346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.396899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 930/1857] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:01.403085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:01.462395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] MFA Rules not processed for user `e8f49c83a9044de78d1cf4fc603e0238`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:01.469215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:01.607279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3db6-3c10-4846-bfdf-31fca1d8d45b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:01.618190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:01.621053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.622213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.623056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.625255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:01.629218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:01.656270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 928/1858] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:01.657381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:01.697791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389ecf-37d9-49e2-b414-24acb6240835 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:01.705914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 931/1859] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/projects => generated 391 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:01.707852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:01.712075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:01.811630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:01.816962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:01.818102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:01.819088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:01.819803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:01.822555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:01.826235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:01.873551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 929/1860] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:01.874736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:01.876597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfde23-620a-403a-a10d-1770a02d602f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:01.950399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:02.033581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.035852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.036128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.036411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.042662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659c0-e924-44ce-aa67-8cb90a3ced5d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.053160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.055331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.055773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.057028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.061845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.065085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.116383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 930/1861] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:01 2022] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:02.118577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.142541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534d2b-ea43-4a3a-b9fa-e6af32799ef9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.149764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.151137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.151683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.152180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.153401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.155875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.162236 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.163930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.190289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 932/1862] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:02.195253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.204760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 931/1863] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:02 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:02.206644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.213798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f1c4-5f15-415b-9e8e-cbefa2cbc3e9 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.220540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.221195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.221514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.221985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.222350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837aadf-1381-400c-805d-583480e938d3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.222702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.224787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.228113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.229208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.229846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.230295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.231317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.234101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.257507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 932/1864] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:02.259604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.262630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 933/1865] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:02.263602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.271350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19393b9-671f-4c08-8589-2488c5dde6c1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.278489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.279412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.279779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.280167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] PATH_INFO: `/v3/users/e8f49c83a9044de78d1cf4fc603e0238` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.281726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f49c83a9044de78d1cf4fc603e0238)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.284418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.288623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a26ae-fa8c-4d79-865a-319055a68d51 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.304615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.305184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.305504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.305788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.321495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.326182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.359203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 934/1866] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:02.360122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.379296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f49c83a9044de78d1cf4fc603e0238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:02.380323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f49c83a9044de78d1cf4fc603e0238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:02.384844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee252d-8d1f-4bd6-8886-355e0d809cf8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.400201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.400906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.401824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.402109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] PATH_INFO: `/v3/projects/91835c62fdde432a968a03fc4c054885/users/c7fc713cb9fc420b830a6709e9e32f57/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.402737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f49c83a9044de78d1cf4fc603e0238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:02.429525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f49c83a9044de78d1cf4fc603e0238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:02.430786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f49c83a9044de78d1cf4fc603e0238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:02.444358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91835c62fdde432a968a03fc4c054885, user_id=c7fc713cb9fc420b830a6709e9e32f57, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.453581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34aa17-ab82-4598-acef-0667c257c19f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.455589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 933/1867] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:02 2022] DELETE /identity/v3/users/e8f49c83a9044de78d1cf4fc603e0238 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:02.456537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.458998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.488942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 935/1868] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:02 2022] PUT /identity/v3/projects/91835c62fdde432a968a03fc4c054885/users/c7fc713cb9fc420b830a6709e9e32f57/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:02.491549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.493504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.493958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.551675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2a-2710-4fc0-acdb-6a471f065639 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.553817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:02.555109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.576688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:02.630965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:02.650436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 936/1869] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:02.652417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.656501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.673476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63455c1-f587-4e0b-9908-845345e48c15 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.676021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.677202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.680594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.681446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.681891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.683018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.684038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.684726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.685166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] PATH_INFO: `/v3/projects/d90cf18623be47ccaf642b117781159d/users/6f2fef4bd32b420798a201bcc09f5c48/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.685698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.701315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 937/1870] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:02.701315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.703224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.704875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90cf18623be47ccaf642b117781159d, user_id=6f2fef4bd32b420798a201bcc09f5c48, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.707654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.721971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 934/1871] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:02 2022] PUT /identity/v3/projects/d90cf18623be47ccaf642b117781159d/users/6f2fef4bd32b420798a201bcc09f5c48/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:02.726699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.773758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e549c6-2938-4107-9ede-fde700079b1d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.797075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384add6-eb84-453f-905f-cde402acc8d1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:02.801820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.802552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.802885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.803164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] PATH_INFO: `/v3/projects/91835c62fdde432a968a03fc4c054885/users/c7fc713cb9fc420b830a6709e9e32f57/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.805202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91835c62fdde432a968a03fc4c054885, user_id=c7fc713cb9fc420b830a6709e9e32f57, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.808020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13345258-9328-43f6-821c-5fd3ddf04413 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.819134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 935/1872] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:02 2022] PUT /identity/v3/projects/91835c62fdde432a968a03fc4c054885/users/c7fc713cb9fc420b830a6709e9e32f57/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:02.820320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.820597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.820872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.829802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:02.830433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.830712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.830985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.841766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:02.843227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d342-0d20-4be3-9bb2-f4bddd06818a service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:02.852332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] MFA Rules not processed for user `6f2fef4bd32b420798a201bcc09f5c48`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:02.853441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 938/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:02.853704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.855891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:02.856200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:02.856470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:02.891653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] MFA Rules not processed for user `c7fc713cb9fc420b830a6709e9e32f57`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:02.893885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:02.923910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 936/1874] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:02.928398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:02.953857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:02.995838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 939/1875] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:03.019905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.021667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.062355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:03.067180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9f65e-f939-4f58-bf59-395accdd8d19 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.077626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.078927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.079595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.080016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.080830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.083579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.098865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9408-9bc3-4840-b681-8e4b7aef5e34 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.107399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.108168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.109546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.110410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.131094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.132909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.142565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 937/1876] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:02 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:03.146217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.159703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 940/1877] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:03.228295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.230618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.244099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a372-e4b8-4bc0-aae0-97015ce79f8c service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.267810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd19e0-47b7-4890-afcb-82962d145aa7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.274357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.275993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.275993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.277874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.278685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.280944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.318105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 938/1878] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:03 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:03.319286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.322363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.340849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c68d-e8ac-4366-b198-5872c6f41bbd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.345833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.346488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.346766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.347046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] PATH_INFO: `/v3/projects/af5cbc35bd594c4fb92402fb6c3dc21e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.349937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5cbc35bd594c4fb92402fb6c3dc21e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.351865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.382251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.383078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.383742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.384121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.387365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.411366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5cbc35bd594c4fb92402fb6c3dc21e', 'request_id': 'req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:03.429077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5cbc35bd594c4fb92402fb6c3dc21e', 'request_id': 'req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:03.439759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5cbc35bd594c4fb92402fb6c3dc21e', 'request_id': 'req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:03.459604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] The token cache is being invalidate because project af5cbc35bd594c4fb92402fb6c3dc21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:03.459953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:03.461027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:03.462965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 939/1879] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:03 2022] DELETE /identity/v3/projects/af5cbc35bd594c4fb92402fb6c3dc21e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:03.463753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.465544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.481344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:03.536240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.538547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417bc1b-9277-46a6-a0c8-c7f0b13ed8a0 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.571916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407c8cb-2bd1-4659-b3ef-36b9d2fb18a7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.572173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 941/1880] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:03.573748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297492-ff77-4cf8-8ddd-664b2227f347 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.585301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297492-ff77-4cf8-8ddd-664b2227f347 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.585301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297492-ff77-4cf8-8ddd-664b2227f347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.594058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.594758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.595042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.595319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.596081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.599129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.624662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 940/1881] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:03.626114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.627485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-80297492-ff77-4cf8-8ddd-664b2227f347 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:03.630622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-80297492-ff77-4cf8-8ddd-664b2227f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.639944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afab9a-b0b7-43c1-9fa9-4d3517e029b0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.645147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.646712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.646950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.647223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] PATH_INFO: `/v3/projects/3cc991896024443e94813ad80cf87143/users/6898f378d91a4c8f8c1df59a39bb5d3d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.654616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 942/1882] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:03.663508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.664017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.664443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.677074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc991896024443e94813ad80cf87143, user_id=6898f378d91a4c8f8c1df59a39bb5d3d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.680137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.704096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 941/1883] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:03 2022] PUT /identity/v3/projects/3cc991896024443e94813ad80cf87143/users/6898f378d91a4c8f8c1df59a39bb5d3d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:03.708014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.726701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:03.728392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:03.843693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f933ec-f29d-4be5-9c33-67451ea9b51e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.865670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.867145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.868580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.869088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.871125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.880601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.901595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:03.905856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.922545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61fd73-1204-4353-8e77-41ee1bb849c2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.922745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 943/1885] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:03.923801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:03.929692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:03.930804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.931249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.931978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] PATH_INFO: `/v3/projects/3cc991896024443e94813ad80cf87143/users/6898f378d91a4c8f8c1df59a39bb5d3d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:03.935379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc991896024443e94813ad80cf87143, user_id=6898f378d91a4c8f8c1df59a39bb5d3d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:03.940206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48ca8e-ac61-4bee-a15c-edcee741e617 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:03.956883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfea753-e7df-4919-9929-99e61adf79e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:03.966019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 943/1886] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:03 2022] PUT /identity/v3/projects/3cc991896024443e94813ad80cf87143/users/6898f378d91a4c8f8c1df59a39bb5d3d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:03.977397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2412-a075-465a-b61b-0db918ea122f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:03.977695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:03.977824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2412-a075-465a-b61b-0db918ea122f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:03.978060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2412-a075-465a-b61b-0db918ea122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.030914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-01ff2412-a075-465a-b61b-0db918ea122f None None] MFA Rules not processed for user `6898f378d91a4c8f8c1df59a39bb5d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:04.032666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01ff2412-a075-465a-b61b-0db918ea122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.069654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.070490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.071138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.071622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.072441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:04.073602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.075392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.121931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 944/1887] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:04.121931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.125824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.126469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:04.159465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 944/1888] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:04.165545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b014-3f2f-414c-ac70-90be9dd82f4e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.165845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b014-3f2f-414c-ac70-90be9dd82f4e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.166126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b014-3f2f-414c-ac70-90be9dd82f4e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.169041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 945/1889] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:47:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:47:04.169863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b014-3f2f-414c-ac70-90be9dd82f4e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.192504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3524bd-6706-4c78-ac5e-4cd069822db6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.195425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b014-3f2f-414c-ac70-90be9dd82f4e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.199191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.199191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.199395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.199536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] PATH_INFO: `/v3/users/4fc0ff898c8048ac8095bdf82ba986a5` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.200750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc0ff898c8048ac8095bdf82ba986a5)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.203541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.208578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.211798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.215417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.216055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.217280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.220921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.267491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 946/1890] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:04 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:04.268653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.272400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.309340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc0ff898c8048ac8095bdf82ba986a5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:04.310224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc0ff898c8048ac8095bdf82ba986a5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:04.319859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc0ff898c8048ac8095bdf82ba986a5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:04.321069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc0ff898c8048ac8095bdf82ba986a5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:04.343051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-239ed6b1-5034-40bb-9a66-90699034e28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc0ff898c8048ac8095bdf82ba986a5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:04.359715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 945/1891] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:04 2022] DELETE /identity/v3/users/4fc0ff898c8048ac8095bdf82ba986a5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:04.361162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.361601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.361976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.374354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304134b3-b34a-4cb6-9aa2-c758dc42d078 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.385984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:04.387495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.440210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.441008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.441700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.442073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.446338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.472512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 946/1892] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:47:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:04.473621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.475238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.496100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:04.552942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.555096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9f291-5a25-4fd3-ac77-79221fe88b13 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.559478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f0c6-2ba9-4260-b689-2e6d83ff7f9b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.564265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.564972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.565259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.565577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.566250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.568289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.577779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 947/1893] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:04.579063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.580171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.580460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.607940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:04.609314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.615724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 947/1894] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:04 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:04.615724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.616794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.625458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 948/1895] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:04.625458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.648002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f267a7-1040-4376-8caa-828766c0eb0a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.650238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5b01-6d63-4f45-8756-cdaad6c225cd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.662885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.663860 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.664741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.665253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.665869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.667349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.667636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.668009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.668357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.670211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.683930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 949/1896] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:04.687738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.688001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.690518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:04.693976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.721817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:04.738592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 948/1897] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:04.740618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.765692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce35ca6-c852-4b78-8d2b-5c02986e3d72 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.774088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.774725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.775005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.775279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.776829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.779137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.794360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 949/1898] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:04.794870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6382a62-00f6-4acf-90e9-81d6cc6c2dc1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.798393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:04.802362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.803017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.803332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.803614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.817094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.818658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd30049-cc0b-402f-baf9-bf38e6eff6ed service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.825966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f67f-acf6-4eb9-9409-d8f4d1078086 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:04.830841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 950/1899] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:04.842242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:04.843078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.843487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.844082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] PATH_INFO: `/v3/projects/8f219bb0856b450baf07b3251ad3d711/users/e41fb8f7c3144060bc9d2c560ce07060/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.862547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f219bb0856b450baf07b3251ad3d711, user_id=e41fb8f7c3144060bc9d2c560ce07060, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:04.866340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:04.898013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 950/1900] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:04 2022] PUT /identity/v3/projects/8f219bb0856b450baf07b3251ad3d711/users/e41fb8f7c3144060bc9d2c560ce07060/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:04.900615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:04.901734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:04.902190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:04.941033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] MFA Rules not processed for user `e41fb8f7c3144060bc9d2c560ce07060`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:04.942177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.042282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 951/1901] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:05.054474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:05.056498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.155555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6238f8-1a04-43a6-b2ee-e3695819ff12 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:05.168500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:05.169360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:05.169864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:05.170746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:05.200783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:05.204520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:05.229060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 951/1902] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:05.293757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:05.294344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.435381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4639-2405-4353-bc3d-d9b95793dfaa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:05.451254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:05.451937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:05.452522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:05.452803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] PATH_INFO: `/v3/projects/eca7a91bb91b4fc2b35f70456ad6cac0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:05.455451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca7a91bb91b4fc2b35f70456ad6cac0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:05.457700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:05.491478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:05.494012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.508896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793556-c827-43b7-aac1-09c07148ec30 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:05.514818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:05.516999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:05.517499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:05.517881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:05.520260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.586610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca7a91bb91b4fc2b35f70456ad6cac0', 'request_id': 'req-fa659b17-03cb-427c-9b11-7ba037bb3604'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:05.594344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:05.614783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca7a91bb91b4fc2b35f70456ad6cac0', 'request_id': 'req-fa659b17-03cb-427c-9b11-7ba037bb3604'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:05.630080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca7a91bb91b4fc2b35f70456ad6cac0', 'request_id': 'req-fa659b17-03cb-427c-9b11-7ba037bb3604'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:05.631747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:05.641291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:05.644375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:05.658581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] The token cache is being invalidate because project eca7a91bb91b4fc2b35f70456ad6cac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:05.659309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:05.662618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:05.667935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 952/1903] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:05 2022] DELETE /identity/v3/projects/eca7a91bb91b4fc2b35f70456ad6cac0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:05.671672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:05.673746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 952/1904] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:05.676322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:05.865267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659b17-03cb-427c-9b11-7ba037bb3604 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:05.877454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:05.879154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:05.879441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:05.881008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] PATH_INFO: `/v3/users/ea2e78d2447c49eb94b0f45757ab51e7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:05.883906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2e78d2447c49eb94b0f45757ab51e7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:05.890723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:06.002136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2e78d2447c49eb94b0f45757ab51e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.003787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2e78d2447c49eb94b0f45757ab51e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.014585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2e78d2447c49eb94b0f45757ab51e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.023584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2e78d2447c49eb94b0f45757ab51e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.024831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a4d672fc-2763-4544-abec-d3b13c0a44c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2e78d2447c49eb94b0f45757ab51e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.048771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 953/1905] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:05 2022] DELETE /identity/v3/users/ea2e78d2447c49eb94b0f45757ab51e7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:06.622201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:06.648568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bfb0-47de-4beb-a701-a2dad4a5a8d2 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:06.773913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:06.774876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:06.775375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:06.776363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] PATH_INFO: `/v3/projects/6fa63b33c9004833a16ff15fbce1331d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:06.777905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa63b33c9004833a16ff15fbce1331d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:06.780484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:06.855739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa63b33c9004833a16ff15fbce1331d', 'request_id': 'req-eabda7b8-cf36-408d-bba3-b6eb476d3a06'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.879050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa63b33c9004833a16ff15fbce1331d', 'request_id': 'req-eabda7b8-cf36-408d-bba3-b6eb476d3a06'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.889556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa63b33c9004833a16ff15fbce1331d', 'request_id': 'req-eabda7b8-cf36-408d-bba3-b6eb476d3a06'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.908631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] The token cache is being invalidate because project 6fa63b33c9004833a16ff15fbce1331d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:06.908926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.909868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-eabda7b8-cf36-408d-bba3-b6eb476d3a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:06.912611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 953/1906] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:06 2022] DELETE /identity/v3/projects/6fa63b33c9004833a16ff15fbce1331d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:06.918600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:06.923723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:06.924012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:06.946428 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:06.947539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:07.013301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:07.032740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.032963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.033168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.042591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 954/1907] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:07.056726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:07.058169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:07.080646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 954/1908] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:07.084452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.097367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288c18-9f91-4682-80ab-c1e0ba2b1d6a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.102418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.103038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.103319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.103592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.104560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:07.105480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.107118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.122171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 955/1909] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:07.126694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.138592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb73a4-78ad-44ef-b736-12e88e914b83 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.143776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.144475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.144796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.145048 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.145917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.147997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.238180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 955/1910] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:07 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:07.250232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.265443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd720-472b-4d19-bb29-6d4a5e7f9f15 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.416235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.417069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.417525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.417815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.420981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.422644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.471646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 956/1911] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:07 2022] POST /identity/v3/users => generated 305 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:07.472735 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.485936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d09fd-c471-4996-9fec-8bc9db4bd543 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.492097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.501632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.501632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.501632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.501632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.501632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.514516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 956/1912] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:07.515692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.528942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e011-fd59-46f1-87d8-b2e5da9f250a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.538019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.539426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.539706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.539988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.546224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.552003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38c357-0242-4157-aed7-84016fa2c364 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.601724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 957/1913] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:07.606413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.623441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce142-45e6-4bbd-8e42-7141178318b4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.630225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.631572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.631572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.631791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] PATH_INFO: `/v3/projects/13022afff0f44caab111a91c313ea263/users/9d9ff5d158ec4847b38f90d65f8ec88c/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.663199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13022afff0f44caab111a91c313ea263, user_id=9d9ff5d158ec4847b38f90d65f8ec88c, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.666250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:07.700162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 957/1914] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:07 2022] PUT /identity/v3/projects/13022afff0f44caab111a91c313ea263/users/9d9ff5d158ec4847b38f90d65f8ec88c/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:07.702270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.702558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.702834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.750812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] MFA Rules not processed for user `9d9ff5d158ec4847b38f90d65f8ec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:07.752157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:07.841488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 958/1915] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:07.843431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:07.877199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:07.938170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8be9f-cb2f-4541-9770-9a670f1a13c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:07.952577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:07.953279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:07.953599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:07.954517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:07.954595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:07.957145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.011251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.011501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 958/1916] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:07 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:08.025618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c57c34-6f08-469a-a822-6e13101d026b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.096082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:08.114086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.114765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.115056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.115330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.116000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.118499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.144853 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 959/1917] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:08 2022] POST /identity/v3/users => generated 311 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:08.149445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.169279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340cba-a8a3-406d-9298-e76ea39e4990 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.193856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.194508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.194788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.195059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.195755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.197399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.216205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 959/1918] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:08.220511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.234126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a327a-cf8f-4645-800c-073e29006343 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.239008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.239862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.240158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.240420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] PATH_INFO: `/v3/projects/3a9224aeba2a4a1893e3548445fe14ed/users/f749fbfca293421a8a415807c6ec3b0e/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.259349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9224aeba2a4a1893e3548445fe14ed, user_id=f749fbfca293421a8a415807c6ec3b0e, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.263036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.277989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 960/1919] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:08 2022] PUT /identity/v3/projects/3a9224aeba2a4a1893e3548445fe14ed/users/f749fbfca293421a8a415807c6ec3b0e/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:08.282204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.294702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111473-49a5-4820-ae8f-486742886aab admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.352899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.355737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:08.359929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.360775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.361147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.361517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.362339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.364008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.372042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15856ce0-b42a-42cf-b636-c77e2aff11b1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.374911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 960/1920] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:08.378221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.378871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.378975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.379708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.380116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] PATH_INFO: `/v3/users/be61e665398a4443bc08843c1059d3de` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.381428 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be61e665398a4443bc08843c1059d3de)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.383820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.391262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db1c6-ae48-4040-905a-3e7485b76966 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.395741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.396414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.396691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.396969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] PATH_INFO: `/v3/projects/3a9224aeba2a4a1893e3548445fe14ed/users/f749fbfca293421a8a415807c6ec3b0e/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.399030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9224aeba2a4a1893e3548445fe14ed, user_id=f749fbfca293421a8a415807c6ec3b0e, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.402298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016293-c0db-4a0b-91e5-336a4afb7ea0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.414417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 961/1921] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:08 2022] PUT /identity/v3/projects/3a9224aeba2a4a1893e3548445fe14ed/users/f749fbfca293421a8a415807c6ec3b0e/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:08.426056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.426346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.426627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.436802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be61e665398a4443bc08843c1059d3de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:08.438432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be61e665398a4443bc08843c1059d3de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:08.447402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be61e665398a4443bc08843c1059d3de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:08.458728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be61e665398a4443bc08843c1059d3de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:08.458991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] MFA Rules not processed for user `f749fbfca293421a8a415807c6ec3b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:08.459568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d609d898-9ad7-4899-9878-16555dc92f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be61e665398a4443bc08843c1059d3de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:08.460205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:08.481397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 961/1922] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:08 2022] DELETE /identity/v3/users/be61e665398a4443bc08843c1059d3de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:08.486331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.486851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.487332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.508710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:08.509963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:08.539192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 962/1923] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:08.551473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.553405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:08.560951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:08.581273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 962/1924] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:08.592390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:08.594994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:08.628292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7bcc7-78a9-47ee-b00a-1d83f8973932 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.639905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:08.672428 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995f074-b2b6-4da2-a026-1060c3c4c76d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:08.677359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.678230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.679088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.679644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.695026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.697104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.701526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:08.702460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:08.703628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:08.703628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:08.714874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 963/1925] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:08.857963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:08.860960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:08.887880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 963/1926] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:09.137312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:09.139063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:09.220093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496a2ed-f0aa-4479-ae0b-ac6749805962 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:09.228742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:09.243357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:09.244522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:09.245813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:09.246591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] PATH_INFO: `/v3/projects/49645294c85f4fe597115d938fbfa611` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:09.247316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ab45-9b27-4a25-a608-65a5e8c65efc service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:09.248418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49645294c85f4fe597115d938fbfa611)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:09.252083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:09.257535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:09.258507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:09.259036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:09.259166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:09.264464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:09.347818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:09.349552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:09.362310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 964/1927] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:09.381555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49645294c85f4fe597115d938fbfa611', 'request_id': 'req-355e6a55-cae5-408d-aecb-9ef8854e65e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.402931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49645294c85f4fe597115d938fbfa611', 'request_id': 'req-355e6a55-cae5-408d-aecb-9ef8854e65e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.413716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49645294c85f4fe597115d938fbfa611', 'request_id': 'req-355e6a55-cae5-408d-aecb-9ef8854e65e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.437214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] The token cache is being invalidate because project 49645294c85f4fe597115d938fbfa611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:09.437532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.442410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.448943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 964/1928] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:09 2022] DELETE /identity/v3/projects/49645294c85f4fe597115d938fbfa611 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:09.450434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:09.469072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e940fd-d8c0-4a05-b921-47c7996bbadb service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:09.497057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:09.574243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:09.574895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:09.575175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:09.575447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] PATH_INFO: `/v3/users/c7fc713cb9fc420b830a6709e9e32f57` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:09.576594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fc713cb9fc420b830a6709e9e32f57)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:09.579100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:09.644550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fc713cb9fc420b830a6709e9e32f57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.645318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fc713cb9fc420b830a6709e9e32f57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.654376 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fc713cb9fc420b830a6709e9e32f57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.655168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fc713cb9fc420b830a6709e9e32f57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.668954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f2138d-b03f-42e6-9de4-bd858a9c4647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fc713cb9fc420b830a6709e9e32f57'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:09.685728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 965/1929] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:09 2022] DELETE /identity/v3/users/c7fc713cb9fc420b830a6709e9e32f57 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:10.006781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.008094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:10.031120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6a55-cae5-408d-aecb-9ef8854e65e7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.114011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.114718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.115006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.115279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] PATH_INFO: `/v3/projects/91835c62fdde432a968a03fc4c054885` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.130439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91835c62fdde432a968a03fc4c054885)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.132388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.215769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91835c62fdde432a968a03fc4c054885', 'request_id': 'req-c736bd75-6b68-465c-9279-2aede18c2450'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:10.223575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91835c62fdde432a968a03fc4c054885', 'request_id': 'req-c736bd75-6b68-465c-9279-2aede18c2450'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:10.231276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:10.233026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91835c62fdde432a968a03fc4c054885', 'request_id': 'req-c736bd75-6b68-465c-9279-2aede18c2450'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:10.254848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] The token cache is being invalidate because project 91835c62fdde432a968a03fc4c054885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:10.255324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:10.256585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c736bd75-6b68-465c-9279-2aede18c2450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:10.258654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 965/1930] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:10 2022] DELETE /identity/v3/projects/91835c62fdde432a968a03fc4c054885 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:10.264209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.264543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.264825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.307772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:10.309269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:10.403114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 966/1931] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:10.412449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.412736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.413016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.468936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:10.470214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:10.493887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 966/1932] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:10.496330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.513512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c57c2-96a6-4289-8c48-f9b0cc1fd042 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.522120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.522961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.523243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.523569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.524332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:10.524692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.540577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.549497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 967/1933] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:10.554056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.568596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c634c3-eeb5-4035-bb27-e0f7651cde52 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.583349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.583349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.583349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.583349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.583804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.583804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.627987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 967/1934] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:10 2022] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:10.631888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.653886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081c2e5-b5dc-4fdb-98b8-7717ae008bc4 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.680860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:10.769675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.770668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.771106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.771534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.772325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.774510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.809922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.810745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 968/1935] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:10 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:10.834611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e73a8e-1058-4be2-a885-defda69a4fc3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.877471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.877471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.877471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.877471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.877991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.877991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.884433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 968/1936] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:10.889596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.895029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.898533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:10.902553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e388-c2af-4d62-b525-500be9552d6b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.909261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.910010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.910331 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.910653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.911407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.913178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.926205 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 969/1937] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:10.930555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:10.941195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87598394-57cf-4eab-8af5-90174dcbda25 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.946111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.946784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.947065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.947345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] PATH_INFO: `/v3/projects/4d24bcb5ee2544f987d1e2328e588ccf/users/24977a9cbef3438c8c74623e990bf9f4/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.970840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d24bcb5ee2544f987d1e2328e588ccf, user_id=24977a9cbef3438c8c74623e990bf9f4, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:10.975381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189ad07-1108-4f9c-819e-0654ae6b152f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:10.983645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d40d-534f-4d19-ae15-624b0359f19a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:10.988720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:10.989552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:10.989863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:10.990135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:10.992880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 970/1938] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:10 2022] PUT /identity/v3/projects/4d24bcb5ee2544f987d1e2328e588ccf/users/24977a9cbef3438c8c74623e990bf9f4/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:10.993572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:11.004030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.004318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.004591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.038593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] MFA Rules not processed for user `24977a9cbef3438c8c74623e990bf9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:11.039866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:11.070848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.072471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.084387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 969/1939] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:11.143875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 971/1940] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:11.148553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.160006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507eb32-75c0-4d5d-806d-a176eaa69ce5 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.227487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.228135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.228385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.228686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.229379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.231331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.241082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:11.270085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 970/1941] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:11 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:11.271155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.283035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ce0d8-a0c4-41e1-b3b2-095fdc4c68e5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.343840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.344562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.344973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.345278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.346117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.348086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.357943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:11.372929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 972/1942] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:11 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:11.377036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.387550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f63cb-2d8f-4fa5-ad0c-cb1a9f40f0a6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.392196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.392808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.393088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.393362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.394086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.395698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.405630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 971/1943] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:11.409943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.420703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09f6d-6b38-4905-890d-fc0e674e3ccd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.425900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.426550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.426830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.427105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] PATH_INFO: `/v3/projects/abe9c023c4784f11a64dff2f334a2232/users/daa8afff00634f5bbf74d105c5002112/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.442860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe9c023c4784f11a64dff2f334a2232, user_id=daa8afff00634f5bbf74d105c5002112, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.445532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.458152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 973/1944] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:11 2022] PUT /identity/v3/projects/abe9c023c4784f11a64dff2f334a2232/users/daa8afff00634f5bbf74d105c5002112/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:11.462254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.472349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa505-b189-47b4-9d42-6efcc93c3e84 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.529639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.530188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.530473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.530754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.531442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.533036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd144e-d846-4bb9-b7e7-f7d11a911e0e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.544039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 972/1945] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:11.547056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.557554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ec5f-990d-4300-a06b-02c1e387dcae admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.562399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.563067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.563348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.563622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] PATH_INFO: `/v3/projects/abe9c023c4784f11a64dff2f334a2232/users/daa8afff00634f5bbf74d105c5002112/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.565611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe9c023c4784f11a64dff2f334a2232, user_id=daa8afff00634f5bbf74d105c5002112, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.568270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.579960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 974/1946] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:11 2022] PUT /identity/v3/projects/abe9c023c4784f11a64dff2f334a2232/users/daa8afff00634f5bbf74d105c5002112/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:11.592738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.593035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.593752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.624705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] MFA Rules not processed for user `daa8afff00634f5bbf74d105c5002112`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:11.626219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:11.702411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 973/1947] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:11.709627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.711382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:11.768989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878e768-d4fa-4dc2-80e1-6d6455914af7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.772832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.773482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.773768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.774043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.783470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.784848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.794469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 975/1948] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:11.884337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:11.895956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208046-6d75-480c-b005-db4b96ce5f00 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:11.899816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:11.901093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:11.901479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:11.901827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:11.965277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:11.966855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa69c-9d74-4e8d-911c-faf02c85ed6a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:11.970531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:11.976771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 974/1949] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:15.714221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:15.715750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:15.781117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7311c1-62d1-4053-baa1-c40538789364 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:15.785661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:15.786343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:15.786628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:15.786899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] PATH_INFO: `/v3/users/0398bfeaaa4341298c6da23fffc13205` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:15.788096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0398bfeaaa4341298c6da23fffc13205)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:15.790080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:15.840896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0398bfeaaa4341298c6da23fffc13205'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:15.841614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0398bfeaaa4341298c6da23fffc13205'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:15.849497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0398bfeaaa4341298c6da23fffc13205'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:15.850115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0398bfeaaa4341298c6da23fffc13205'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:15.852931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:15.865769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0398bfeaaa4341298c6da23fffc13205'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:15.881895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 976/1950] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:15 2022] DELETE /identity/v3/users/0398bfeaaa4341298c6da23fffc13205 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:15.888541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:15.889560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:15.890116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:15.917497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:15.919077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:15.990834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 975/1951] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:16.000535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:16.002196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:16.061127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9150-25a9-4374-98c3-3b49ce992167 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:16.064706 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:16.065393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:16.065694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:16.065960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:16.075872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:16.077307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:16.087111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 977/1952] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:16.390491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:16.392133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:16.426341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52e9ab-3260-4b68-8c1d-aa50a3377e57 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:16.445791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:16.446472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:16.446763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:16.447050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] PATH_INFO: `/v3/projects/df551fbeee984dc68407d586589dd4fd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:16.450503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df551fbeee984dc68407d586589dd4fd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:16.452429 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:16.515979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df551fbeee984dc68407d586589dd4fd', 'request_id': 'req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.522815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df551fbeee984dc68407d586589dd4fd', 'request_id': 'req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.531043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df551fbeee984dc68407d586589dd4fd', 'request_id': 'req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.546582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] The token cache is being invalidate because project df551fbeee984dc68407d586589dd4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:16.546878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.547543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.549648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 976/1953] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:16 2022] DELETE /identity/v3/projects/df551fbeee984dc68407d586589dd4fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:16.553353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:16.566561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c948-135b-4e3b-839d-fae15677234d service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:16.641669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:16.642342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:16.642607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:16.642884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] PATH_INFO: `/v3/users/6f2fef4bd32b420798a201bcc09f5c48` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:16.644066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2fef4bd32b420798a201bcc09f5c48)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:16.646043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:16.697849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2fef4bd32b420798a201bcc09f5c48'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.698392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2fef4bd32b420798a201bcc09f5c48'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.706241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2fef4bd32b420798a201bcc09f5c48'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.707098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2fef4bd32b420798a201bcc09f5c48'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.720419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2fef4bd32b420798a201bcc09f5c48'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:16.726067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:16.734974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 978/1954] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:16 2022] DELETE /identity/v3/users/6f2fef4bd32b420798a201bcc09f5c48 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:17.163524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:17.165318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:17.183496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e99c-4da5-4818-ae2d-5d2b4804b9d0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:17.256462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:17.257037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:17.257323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:17.257626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] PATH_INFO: `/v3/projects/d90cf18623be47ccaf642b117781159d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:17.258822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90cf18623be47ccaf642b117781159d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:17.260788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:17.286620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:17.313518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90cf18623be47ccaf642b117781159d', 'request_id': 'req-dfcc151e-6871-4b68-ab87-15a7e95f89ed'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.322294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90cf18623be47ccaf642b117781159d', 'request_id': 'req-dfcc151e-6871-4b68-ab87-15a7e95f89ed'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.328260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90cf18623be47ccaf642b117781159d', 'request_id': 'req-dfcc151e-6871-4b68-ab87-15a7e95f89ed'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.343059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] The token cache is being invalidate because project d90cf18623be47ccaf642b117781159d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:17.343616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.344443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.348937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 977/1955] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:17 2022] DELETE /identity/v3/projects/d90cf18623be47ccaf642b117781159d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:17.351131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:17.353107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:17.380792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d63e-67e6-46bd-afb7-11b09ed3069d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:17.444866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:17.445501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:17.445842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:17.446059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] PATH_INFO: `/v3/users/6898f378d91a4c8f8c1df59a39bb5d3d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:17.448505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6898f378d91a4c8f8c1df59a39bb5d3d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:17.450721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:17.509574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6898f378d91a4c8f8c1df59a39bb5d3d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.510308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6898f378d91a4c8f8c1df59a39bb5d3d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.521535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6898f378d91a4c8f8c1df59a39bb5d3d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.522687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6898f378d91a4c8f8c1df59a39bb5d3d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.539247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-643d6061-e2d9-40dd-8acd-eec5f2182c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6898f378d91a4c8f8c1df59a39bb5d3d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.557687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 979/1956] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:17 2022] DELETE /identity/v3/users/6898f378d91a4c8f8c1df59a39bb5d3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:17.854041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:17.856001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:17.870425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc151e-6871-4b68-ab87-15a7e95f89ed admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:17.934991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:17.935651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:17.935933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:17.936209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] PATH_INFO: `/v3/projects/3cc991896024443e94813ad80cf87143` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:17.937375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc991896024443e94813ad80cf87143)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:17.939321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:17.985943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc991896024443e94813ad80cf87143', 'request_id': 'req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.992229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc991896024443e94813ad80cf87143', 'request_id': 'req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:17.998470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc991896024443e94813ad80cf87143', 'request_id': 'req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:18.015906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] The token cache is being invalidate because project 3cc991896024443e94813ad80cf87143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:18.016328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:18.017322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c07cf15f-c4f9-4b0e-82aa-bc6cbb38fb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:18.023462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 978/1957] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:17 2022] DELETE /identity/v3/projects/3cc991896024443e94813ad80cf87143 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:18.025029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.025605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.025831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.047391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:18.050722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:18.111411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 980/1958] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:18.120572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.120851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.121124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.140757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:18.141976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:18.149773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 979/1959] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:18.154159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.163797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ce68-a35b-4ce8-b932-8de76a8077fe None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.169099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.169745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.170026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.170303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.171015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:18.171321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.172915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.193161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 981/1960] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:18.194774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.205290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958331e2-7abe-45be-bc2b-2d5a9fa5756c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.210179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.210882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.211237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.211591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.212333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.215145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.242932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 980/1961] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:18.247269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.252824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:18.260734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337185-e6b7-42cd-8f96-62faccb8e480 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.321167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.321832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.322795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.323150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.323827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.325788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.349401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 982/1962] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:18.353737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.364827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d92d-9657-4ea2-a3b1-5a38676a09d2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.369772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.370413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.370697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.370971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.371672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.373298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.385125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 981/1963] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:18.390417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.400019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94883-41ad-45d1-8d84-10dc1d185381 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.405953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.406613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.407151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.407447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.408156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.409863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d2b3f-25e2-4e6f-a6f0-1618d0a68d12 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.422329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 983/1964] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:18.426601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.433888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:18.441472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f684ba-2d25-43a4-8c55-27465b08b925 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.448339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.449139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.449567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.449950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] PATH_INFO: `/v3/projects/43e98fbca8774f9ba72a03374601c848/users/1c15899d78de46d2ad0d77236758e828/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.483482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e98fbca8774f9ba72a03374601c848, user_id=1c15899d78de46d2ad0d77236758e828, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.486469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.500538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 982/1965] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:18 2022] PUT /identity/v3/projects/43e98fbca8774f9ba72a03374601c848/users/1c15899d78de46d2ad0d77236758e828/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:18.511607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.512238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.512605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.540472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] MFA Rules not processed for user `1c15899d78de46d2ad0d77236758e828`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:18.542325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:18.632232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 984/1966] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:18.637170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.740175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c2108-179e-4cf5-a346-d8f09658fea0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.747724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.748738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.749028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.749315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.750215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.752406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.789069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 983/1967] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:18.794241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.807226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fcc6b-70d8-45f1-9515-d35a7f5e687d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.885921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.886873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.887162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.887431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.888097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.890223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.909188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:18.918539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 985/1968] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:18 2022] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:18.919745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.930217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf550-89e6-4a3a-a11e-03fb09f0c312 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.935003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.935628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.935912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.936188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.936876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.938553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:18.949840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 984/1969] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:18.953997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:18.964900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9c64-7782-406a-bbab-3b1f6dfcb0cd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:18.969876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:18.970555 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:18.970908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:18.971110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] PATH_INFO: `/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6/users/61a5abc8b2a5480e99a5b99c4f3a38f4/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:18.990936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b0caf296a44a8f86a0240b8100dfb6, user_id=61a5abc8b2a5480e99a5b99c4f3a38f4, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:18.994867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.015565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 986/1970] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:18 2022] PUT /identity/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6/users/61a5abc8b2a5480e99a5b99c4f3a38f4/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:19.016648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.026774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa94b-5940-4a53-b182-25ce1d4144a5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.086565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:19.087096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.087375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.087653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.088927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:19.090634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568af36f-dff1-4e53-a527-0667e79a0058 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.100368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 985/1971] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:19.104635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.115065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87219-433f-480e-97cb-a3635e3a2f59 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.119866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:19.120690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.120973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.121252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] PATH_INFO: `/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6/users/61a5abc8b2a5480e99a5b99c4f3a38f4/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.123246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b0caf296a44a8f86a0240b8100dfb6, user_id=61a5abc8b2a5480e99a5b99c4f3a38f4, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:19.125961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.136958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 987/1972] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:19 2022] PUT /identity/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6/users/61a5abc8b2a5480e99a5b99c4f3a38f4/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:19.146922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.147220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.147476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.175108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] MFA Rules not processed for user `61a5abc8b2a5480e99a5b99c4f3a38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:19.176318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:19.214415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:19.244938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 986/1973] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:19.255904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.257573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:19.315324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d9f9-1c65-4a0c-beb4-2a05b3fe12cb admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.318917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:19.319532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.319810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.320082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.329802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:19.331248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823b7d-c223-4166-8f6d-94d4aa64ece5 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.340623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 988/1974] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:19.475707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.548956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281b87-2f0d-40fd-b71b-c571814e5464 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.554904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:19.555569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.555851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.556127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] PATH_INFO: `/v3/users/1c15899d78de46d2ad0d77236758e828` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.557834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c15899d78de46d2ad0d77236758e828)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:19.559785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.611881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c15899d78de46d2ad0d77236758e828'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:19.612895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c15899d78de46d2ad0d77236758e828'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:19.621991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c15899d78de46d2ad0d77236758e828'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:19.630404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c15899d78de46d2ad0d77236758e828'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:19.631996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c15899d78de46d2ad0d77236758e828'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:19.655905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 987/1975] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:19 2022] DELETE /identity/v3/users/1c15899d78de46d2ad0d77236758e828 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:19.659948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.660448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.660691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.683080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:19.693644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:19.765823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 989/1976] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:19.777573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.779037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:19.856023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abb7e2-fe44-4e4d-b213-eb869d42583e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.861865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:19.862539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:19.863091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:19.863636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:19.874688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:19.878118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:19.881532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a705c-c22b-4cee-8758-f3d89b503300 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:19.902353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 988/1977] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:19.972475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:19.974006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:19.993468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d642-6a6a-45d7-9418-43c3b1ddcb26 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:19.999632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.000343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.000625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.000910 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] PATH_INFO: `/v3/users/9d9ff5d158ec4847b38f90d65f8ec88c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.002145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9ff5d158ec4847b38f90d65f8ec88c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.004516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:20.087665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9ff5d158ec4847b38f90d65f8ec88c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.089861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9ff5d158ec4847b38f90d65f8ec88c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.102980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9ff5d158ec4847b38f90d65f8ec88c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.104521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9ff5d158ec4847b38f90d65f8ec88c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.115435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:20.131727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9ff5d158ec4847b38f90d65f8ec88c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.175348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 990/1978] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:19 2022] DELETE /identity/v3/users/9d9ff5d158ec4847b38f90d65f8ec88c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:20.180229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.180542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.180697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.217371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:20.218916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.248837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:20.248837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.326493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 989/1979] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:20.332840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:20.338239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.349568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496410a-71ef-4e02-9f1d-893d11e999c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:20.356578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.360499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.360833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.361295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] PATH_INFO: `/v3/users/24977a9cbef3438c8c74623e990bf9f4` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.362878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24977a9cbef3438c8c74623e990bf9f4)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.366632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:20.423171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa311b-fcf7-44b7-be91-6847e4c1c345 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:20.427369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.428149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.428434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.428709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.441269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.442780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c6d70-9d58-4255-b107-458389ade9a5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:20.450893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24977a9cbef3438c8c74623e990bf9f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.451908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24977a9cbef3438c8c74623e990bf9f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.455828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 990/1980] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:20.464655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24977a9cbef3438c8c74623e990bf9f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.465319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24977a9cbef3438c8c74623e990bf9f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.485134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24977a9cbef3438c8c74623e990bf9f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.505125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.505961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.505961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.509478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 991/1981] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:20 2022] DELETE /identity/v3/users/24977a9cbef3438c8c74623e990bf9f4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:20.531235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:20.532475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.609922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 991/1982] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:20.630224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:20.632168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.711777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4273b-b8b2-4722-b708-2bc7f63d0499 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:20.716419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.717059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.717344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.717679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.728178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.730094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:20.737792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:20.745907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 992/1983] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:20.801639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:20.804264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:20.821383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad300d2-142b-497e-b1c8-a5158d283f36 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:20.827599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.828252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.828529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.828799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] PATH_INFO: `/v3/projects/43e98fbca8774f9ba72a03374601c848` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.830008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e98fbca8774f9ba72a03374601c848)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.831905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:20.874593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:20.885771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e98fbca8774f9ba72a03374601c848', 'request_id': 'req-88c411a4-a15e-4552-9039-bd65e97f9305'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.893070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e98fbca8774f9ba72a03374601c848', 'request_id': 'req-88c411a4-a15e-4552-9039-bd65e97f9305'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.899263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e98fbca8774f9ba72a03374601c848', 'request_id': 'req-88c411a4-a15e-4552-9039-bd65e97f9305'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.914222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] The token cache is being invalidate because project 43e98fbca8774f9ba72a03374601c848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:20.914512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.915245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:20.917053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 992/1984] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:20 2022] DELETE /identity/v3/projects/43e98fbca8774f9ba72a03374601c848 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:20.921107 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:20.931109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9fd4-8529-4d05-b86f-c8b998b3a52f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:20.990687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:20.991361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:20.991637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:20.991909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] PATH_INFO: `/v3/users/61a5abc8b2a5480e99a5b99c4f3a38f4` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:20.993080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a5abc8b2a5480e99a5b99c4f3a38f4)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:20.995573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.055536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a5abc8b2a5480e99a5b99c4f3a38f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.056219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a5abc8b2a5480e99a5b99c4f3a38f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.065697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a5abc8b2a5480e99a5b99c4f3a38f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.066360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a5abc8b2a5480e99a5b99c4f3a38f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.080216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a5abc8b2a5480e99a5b99c4f3a38f4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.094089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 993/1985] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:20 2022] DELETE /identity/v3/users/61a5abc8b2a5480e99a5b99c4f3a38f4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:21.335755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.338566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.354663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c411a4-a15e-4552-9039-bd65e97f9305 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:21.469153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:21.470249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.470620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.470851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] PATH_INFO: `/v3/projects/13022afff0f44caab111a91c313ea263` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.472596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13022afff0f44caab111a91c313ea263)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:21.475044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.481362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.483410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.524420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52b47-0e70-4b00-85d0-4fa35614a40e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:21.538755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:21.540008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.541633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.542122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] PATH_INFO: `/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.546285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b0caf296a44a8f86a0240b8100dfb6)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:21.551131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.625704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13022afff0f44caab111a91c313ea263', 'request_id': 'req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.632094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13022afff0f44caab111a91c313ea263', 'request_id': 'req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.632937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b0caf296a44a8f86a0240b8100dfb6', 'request_id': 'req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.640327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b0caf296a44a8f86a0240b8100dfb6', 'request_id': 'req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.641439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13022afff0f44caab111a91c313ea263', 'request_id': 'req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.649333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b0caf296a44a8f86a0240b8100dfb6', 'request_id': 'req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.657751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] The token cache is being invalidate because project 13022afff0f44caab111a91c313ea263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:21.658143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.658866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.665342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 993/1986] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:21 2022] DELETE /identity/v3/projects/13022afff0f44caab111a91c313ea263 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:21.665633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] The token cache is being invalidate because project e1b0caf296a44a8f86a0240b8100dfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:21.665633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.666797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f7ca9ef0-1653-4599-a830-bf6215b9f5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.666931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.671691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.671823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 994/1987] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:21 2022] DELETE /identity/v3/projects/e1b0caf296a44a8f86a0240b8100dfb6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:21.673644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3af-d729-4eb5-b162-3c135a240488 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.673813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3af-d729-4eb5-b162-3c135a240488 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.674256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3af-d729-4eb5-b162-3c135a240488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.684419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:21.704182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1488f3af-d729-4eb5-b162-3c135a240488 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:21.705699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1488f3af-d729-4eb5-b162-3c135a240488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.735038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:21.751080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b1d2-6d6b-4cfd-8b5f-324afb405238 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:21.782139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 995/1988] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:21.793329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.793779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.794104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.823294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:21.824752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.831217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:21.832759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.832759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.832759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] PATH_INFO: `/v3/users/f749fbfca293421a8a415807c6ec3b0e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.834298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f749fbfca293421a8a415807c6ec3b0e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:21.836735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.838723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 996/1989] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:21.843759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.858313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e15c-d065-4517-a726-a8fb252a6607 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:21.863298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:21.864131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.864419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.864696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.865400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:21.865734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:21.868052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.889254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 997/1990] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:21.893488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.905643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8099-530a-4059-8b12-c02c2fff5cc7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:21.916420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:21.917257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:21.917620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:21.918314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:21.919541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:21.920764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f749fbfca293421a8a415807c6ec3b0e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.921542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f749fbfca293421a8a415807c6ec3b0e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.923005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:21.942698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f749fbfca293421a8a415807c6ec3b0e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.952687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f749fbfca293421a8a415807c6ec3b0e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.953586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f749fbfca293421a8a415807c6ec3b0e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:21.963423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 998/1991] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:21 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:21.974985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 994/1992] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:21 2022] DELETE /identity/v3/users/f749fbfca293421a8a415807c6ec3b0e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:21.975670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.977100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:21.985792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:21.998339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.084106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442dc3-3599-4b1c-81dd-435a3d52d674 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.095732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.096658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.099362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.099650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.100338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.104455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.147427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e88b1-5a2b-4eb6-9c04-7c5d8a3208d1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.155324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.156075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.156434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.156768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] PATH_INFO: `/v3/projects/4d24bcb5ee2544f987d1e2328e588ccf` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.158358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d24bcb5ee2544f987d1e2328e588ccf)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.161626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 995/1993] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:21 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:22.161734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.163002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.194165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019fa6-776d-482a-866a-6adba1943de1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.200130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.200824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.201055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.201334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.202643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.204907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.207379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:22.240595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 996/1994] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:22.244752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.271285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856c47d-6dcd-4eed-8963-50e6803bf7d2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.283264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d24bcb5ee2544f987d1e2328e588ccf', 'request_id': 'req-bb1106a1-03f7-41fa-a797-82400d219baf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.292729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d24bcb5ee2544f987d1e2328e588ccf', 'request_id': 'req-bb1106a1-03f7-41fa-a797-82400d219baf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.298738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:22.305385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d24bcb5ee2544f987d1e2328e588ccf', 'request_id': 'req-bb1106a1-03f7-41fa-a797-82400d219baf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.326147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] The token cache is being invalidate because project 4d24bcb5ee2544f987d1e2328e588ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:22.326147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.327096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.329447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 999/1995] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:21 2022] DELETE /identity/v3/projects/4d24bcb5ee2544f987d1e2328e588ccf => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:22.335388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.338285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.405268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.406537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.407014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.407615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.408511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.411156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.428427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 997/1996] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:22.429535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.431711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.445634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed0a46-130e-494b-b447-515ac23d6a3c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.450810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.451586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.451975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.452626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] PATH_INFO: `/v3/projects/3a9224aeba2a4a1893e3548445fe14ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.463325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9224aeba2a4a1893e3548445fe14ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.467061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.468428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1106a1-03f7-41fa-a797-82400d219baf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.473543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.474197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.474476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.474750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] PATH_INFO: `/v3/users/daa8afff00634f5bbf74d105c5002112` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.476113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa8afff00634f5bbf74d105c5002112)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.478215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.539955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9224aeba2a4a1893e3548445fe14ed', 'request_id': 'req-fc6452e0-3983-43ad-94c7-7c9345ceaa98'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.551765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9224aeba2a4a1893e3548445fe14ed', 'request_id': 'req-fc6452e0-3983-43ad-94c7-7c9345ceaa98'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.556155 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa8afff00634f5bbf74d105c5002112'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.557762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa8afff00634f5bbf74d105c5002112'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.563953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9224aeba2a4a1893e3548445fe14ed', 'request_id': 'req-fc6452e0-3983-43ad-94c7-7c9345ceaa98'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.576307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa8afff00634f5bbf74d105c5002112'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.577059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa8afff00634f5bbf74d105c5002112'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.592842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-449e3577-a011-4b00-8a0f-6d939961ab53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa8afff00634f5bbf74d105c5002112'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.593767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] The token cache is being invalidate because project 3a9224aeba2a4a1893e3548445fe14ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:22.594214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.595778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:22.597480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 998/1997] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:22 2022] DELETE /identity/v3/projects/3a9224aeba2a4a1893e3548445fe14ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:22.598784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.602783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.644403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1000/1998] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:22 2022] DELETE /identity/v3/users/daa8afff00634f5bbf74d105c5002112 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:22.662070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c015b4-54df-46a7-b5d2-14b063f4838b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.664860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c015b4-54df-46a7-b5d2-14b063f4838b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.665175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c015b4-54df-46a7-b5d2-14b063f4838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.712002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-64c015b4-54df-46a7-b5d2-14b063f4838b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:22.714960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-64c015b4-54df-46a7-b5d2-14b063f4838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.720629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6452e0-3983-43ad-94c7-7c9345ceaa98 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.757166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:22.830241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1001/1999] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:22.839762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:22.840226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.840580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.841296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] PATH_INFO: `/v3/projects/31055b96b3cf411da61afb0a2cd7cf0a/users/b87d0ad5be00458b817057b00186bd8d/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.841694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.841997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.842277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.863997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31055b96b3cf411da61afb0a2cd7cf0a, user_id=b87d0ad5be00458b817057b00186bd8d, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:22.866905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e045f-359f-4f19-89f4-04b3f747856f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:22.870797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:22.872336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:22.895888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1002/2000] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:22.898301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 999/2001] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:22 2022] PUT /identity/v3/projects/31055b96b3cf411da61afb0a2cd7cf0a/users/b87d0ad5be00458b817057b00186bd8d/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:22.912070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:22.913179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:22.916699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:22.917127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:22.924473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:22.935728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e31691-b56d-4848-93b8-2315fe64523c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:22.958846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] MFA Rules not processed for user `b87d0ad5be00458b817057b00186bd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:22.960755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.028229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.029605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.030472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.031114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.032371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:23.032929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.035704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.050990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1003/2002] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:23.054920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.058179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1000/2003] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:23.067007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b0219-bdfe-40bd-a3ee-e86a6a3cd2d3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.069883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.071264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.073632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.074663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.075117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.075638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.076613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.079024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.135237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1004/2004] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:23.136945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.194818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89a80-0c2a-47c1-94a4-4f396460a080 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.245657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a1f46-6737-4b7e-afcf-17667960e8b8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.253042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.254079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.255137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.255620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.257729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.262591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.328526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1005/2005] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:23.329617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.337044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.339312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.340406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.340406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.341563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdbeab-6968-4116-b2ee-42f8f86825b1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.347422 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.348159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.348513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.348922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.349956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.351286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:23.351618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.368027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1006/2006] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:23.369339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.382165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe181-1dac-40f7-bfdc-af324568afdf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.389572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.390298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.390652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.391454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.392241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.394131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.409941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1007/2007] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:23.414431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.426568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782b1df-5da0-4e68-83bd-5c3b1e52d40a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.432188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.433048 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.433985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.433985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] PATH_INFO: `/v3/projects/97eee4867dfd4ee6a22fd191d579cf6c/users/563d52b6ccf44064b329795a7fe8f73a/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.454072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eee4867dfd4ee6a22fd191d579cf6c, user_id=563d52b6ccf44064b329795a7fe8f73a, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.457864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.464125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.466670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c25762-8070-440d-a1b1-fc922b3b73eb service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.486246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1001/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:23.486918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1008/2009] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:23 2022] PUT /identity/v3/projects/97eee4867dfd4ee6a22fd191d579cf6c/users/563d52b6ccf44064b329795a7fe8f73a/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:23.488386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.489013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.489509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.533490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.542211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] MFA Rules not processed for user `563d52b6ccf44064b329795a7fe8f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:23.544370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.592772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:23.656374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec23e6-de4a-4efb-ba4a-958149cbbfda admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.663628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.664648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.665131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.665708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] PATH_INFO: `/v3/users/b87d0ad5be00458b817057b00186bd8d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.667624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87d0ad5be00458b817057b00186bd8d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.669832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1002/2010] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:23.671390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.671943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.674806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.698855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ffd6-729b-4e5f-8498-f968d1026c02 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.708143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.709264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.709794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.710288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] PATH_INFO: `/v3/projects/abe9c023c4784f11a64dff2f334a2232` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.712332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe9c023c4784f11a64dff2f334a2232)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.716797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.747533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87d0ad5be00458b817057b00186bd8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.748664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87d0ad5be00458b817057b00186bd8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.759143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87d0ad5be00458b817057b00186bd8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.762025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87d0ad5be00458b817057b00186bd8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.778344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87d0ad5be00458b817057b00186bd8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.787016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe9c023c4784f11a64dff2f334a2232', 'request_id': 'req-93db42ee-e4b9-422a-ba59-622e0c181da4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.794255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe9c023c4784f11a64dff2f334a2232', 'request_id': 'req-93db42ee-e4b9-422a-ba59-622e0c181da4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.796720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1009/2011] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:23 2022] DELETE /identity/v3/users/b87d0ad5be00458b817057b00186bd8d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:23.797634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.799040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.802139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe9c023c4784f11a64dff2f334a2232', 'request_id': 'req-93db42ee-e4b9-422a-ba59-622e0c181da4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.818377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] The token cache is being invalidate because project abe9c023c4784f11a64dff2f334a2232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:23.818669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.819325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-93db42ee-e4b9-422a-ba59-622e0c181da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:23.821104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1003/2012] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:23 2022] DELETE /identity/v3/projects/abe9c023c4784f11a64dff2f334a2232 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:23.822867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f1d2-25d9-4d1b-8c84-9f25a3f49357 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.823231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f1d2-25d9-4d1b-8c84-9f25a3f49357 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.823513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6f1d2-25d9-4d1b-8c84-9f25a3f49357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.843894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6ff6f1d2-25d9-4d1b-8c84-9f25a3f49357 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:23.844719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6ff6f1d2-25d9-4d1b-8c84-9f25a3f49357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.859539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:23.887618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495c91-1938-4d73-abcd-57f12522a112 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:23.892480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:23.893124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.893409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.893715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.894396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:23.896369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:23.937047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1004/2013] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:23.938816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:23.939222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:23.939711 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:23.943447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1010/2014] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:23.964186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:23.965535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:23.966764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:23.970097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:24.035644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:24.062421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1005/2015] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:24.062421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.062421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:24.116611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851a4a-ae93-4af3-b89f-c3a24d99e86b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.130631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.131277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.131558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.131836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.132648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.135005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c552fc-6edb-4d89-9e4a-172a001907a7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.135170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.139451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.140090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.140374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.140651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.153961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.155425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed7b85-4ad6-44e2-84ea-8e7de3bd0a89 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.168778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1006/2016] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:24.171404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.171703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.172032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.185548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1011/2017] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:23 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:24.191587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.202009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:24.203267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:24.207873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b15eda-7d14-49c6-8b5c-491ebdbd77b6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.211807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1007/2018] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:24.213334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.213691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.214001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.214299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.215375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.216142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.217268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.225384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3080-c176-467b-b6b9-70544c7e6811 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.231289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.231922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.232209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.232510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.233079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1012/2019] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:24.233272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:24.233865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.233994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.236216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.249379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a74-eeb1-4405-8bec-7834f4953542 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.257069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.258202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.258550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1008/2020] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:47:24.258995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.259583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] PATH_INFO: `/v3/projects/2771cb3b3f9a4164ad00a85356164e98/users/b9ffff0af3674435948d2a3a321106ed/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.262995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.283699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2771cb3b3f9a4164ad00a85356164e98, user_id=b9ffff0af3674435948d2a3a321106ed, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.283918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e992-12ba-4042-b434-fe3555caf0ce admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.287501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.300381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.300932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.301482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.301482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.302157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.304119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.307546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1013/2021] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:24 2022] PUT /identity/v3/projects/2771cb3b3f9a4164ad00a85356164e98/users/b9ffff0af3674435948d2a3a321106ed/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:24.314023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.384132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1009/2022] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:24 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:24.385529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.422923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:24.473137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899aaad-aa3f-40b4-a2df-b994ef15de01 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.475472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6e976-73fd-48e0-8eac-39c3f0e82a1b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.486636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.487293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.487579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.487858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.491359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.493504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.503826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.505499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.505784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.506108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.506875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.509043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.530425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1014/2023] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:24.537922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1010/2024] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:24 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:24.539312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.542324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.554315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6815e43-2026-474f-afa5-403003e71650 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.561536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af9859-089f-4f3e-9e32-8b98125c91d6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.562493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.563202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.570394 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.574311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.575082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.576567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.577116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.577826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] PATH_INFO: `/v3/projects/2771cb3b3f9a4164ad00a85356164e98/users/b9ffff0af3674435948d2a3a321106ed/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.579097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.580872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.581483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2771cb3b3f9a4164ad00a85356164e98, user_id=b9ffff0af3674435948d2a3a321106ed, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.584713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e78e-a12b-4c78-842c-af5e586256e9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.603104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1015/2025] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:24 2022] PUT /identity/v3/projects/2771cb3b3f9a4164ad00a85356164e98/users/b9ffff0af3674435948d2a3a321106ed/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:24.615441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.617721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.618018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.624458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1011/2026] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:24.625653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.654974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42fa45-35fc-453d-a88c-991b7f8c1707 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.685664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] MFA Rules not processed for user `b9ffff0af3674435948d2a3a321106ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:24.686914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:24.777897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:24.781379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.782234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.783796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.792585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.792585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.795492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.828409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1012/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:24.829630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.831750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1016/2028] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:24.850752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b600-98af-4f62-b246-b3bd88f936e4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:24.857217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:24.859563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:24.877823 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:24.878674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.879050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.879398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] PATH_INFO: `/v3/projects/25234e11a1004ee6ae9a9e761646e35b/users/dbfda3fadd81431aafd614533c84d830/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:24.914254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25234e11a1004ee6ae9a9e761646e35b, user_id=dbfda3fadd81431aafd614533c84d830, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:24.923334 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d20c4-154f-4f18-883c-65936332e905 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:24.945538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1013/2029] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:24 2022] PUT /identity/v3/projects/25234e11a1004ee6ae9a9e761646e35b/users/dbfda3fadd81431aafd614533c84d830/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:24.964733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:24.965351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:24.965677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.020405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47eb5-ea70-45c5-9c02-9fcdfb7aa6e5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.034618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] MFA Rules not processed for user `dbfda3fadd81431aafd614533c84d830`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:25.038998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.165851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.166610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.167128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.167481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.170247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1014/2030] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:25.171431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.173111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.200197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:25.335037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4453e-b185-4c46-9f7a-e4d81a90b0d0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.340774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.342285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.344901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.345785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.346250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.346688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] PATH_INFO: `/v3/projects/31055b96b3cf411da61afb0a2cd7cf0a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.349037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31055b96b3cf411da61afb0a2cd7cf0a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.351502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.372606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1017/2031] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:25.373901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.399616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ca245-92a4-4f4a-aeb4-975b2b99f0df service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.415017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.416224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.416514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.416786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.418512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.420451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe8fa-f29c-402d-9c9f-e27b9f1039df admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.449448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31055b96b3cf411da61afb0a2cd7cf0a', 'request_id': 'req-34181e6d-9148-4eff-b282-87932bd5a778'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:25.461444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31055b96b3cf411da61afb0a2cd7cf0a', 'request_id': 'req-34181e6d-9148-4eff-b282-87932bd5a778'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:25.472937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31055b96b3cf411da61afb0a2cd7cf0a', 'request_id': 'req-34181e6d-9148-4eff-b282-87932bd5a778'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:25.499969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] The token cache is being invalidate because project 31055b96b3cf411da61afb0a2cd7cf0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:25.500746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:25.501737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:25.506788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1015/2032] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:25 2022] DELETE /identity/v3/projects/31055b96b3cf411da61afb0a2cd7cf0a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:25.506788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.506788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.518648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1018/2033] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:25 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:25.518648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.518648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.518648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.548767 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:25.550447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.603925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:25.608597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181e6d-9148-4eff-b282-87932bd5a778 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.685833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1019/2034] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:25.686982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.690604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.728083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5f805-ec87-42d6-a624-08effe94406f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.756964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.757985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.758928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.759055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.760220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.764943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b8da-b65e-407e-81ea-3a2830d626b5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.768647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:25.779996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.780885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.781359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.782347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.789124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.805561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1020/2035] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:25 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:25.810164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.810467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.810748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.849301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:25.851311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:25.877337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1021/2036] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:25.882297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.905010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16572061-0499-4463-8b0b-1b2717db2f26 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.918439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.919381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.920046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.920425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.921234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.924649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.934150 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:25.936417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:25.951893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1022/2037] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:25.953113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1016/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:25.954630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.956136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:25.979668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203370-c795-4e23-96d6-6bc203e08904 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.981219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db036-fee3-4f65-8e23-35d8cc5e5959 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:25.993442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:25.994939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:25.995398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:25.995752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:25.996623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:25.997115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.001284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.003722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.005474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.006478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.006793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.007584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.012142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.036715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1017/2039] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:26.042089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.053864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1023/2040] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:26.058584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.073695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892006-31e6-4f2b-8098-80127bbaab20 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.083424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.084244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.084908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.085293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.086089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.090267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217118f9-7a3f-480b-abad-2df0b8446b39 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.101844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9012ce-a2b7-41fc-a192-d081d7a1ba5f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.119900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.121101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.121101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.121323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] PATH_INFO: `/v3/projects/9764b7f5160e41c49c91cc2510e54f69/users/a44e059997a240f68829c2484e567848/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.153720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9764b7f5160e41c49c91cc2510e54f69, user_id=a44e059997a240f68829c2484e567848, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.158242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.187523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1018/2041] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:26 2022] PUT /identity/v3/projects/9764b7f5160e41c49c91cc2510e54f69/users/a44e059997a240f68829c2484e567848/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:26.198118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.198596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1024/2042] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:26.206363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.206649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.206992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.285763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] MFA Rules not processed for user `a44e059997a240f68829c2484e567848`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:26.289318 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:26.369641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97381-54bf-46af-99c1-e4b1b1182b53 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.448862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1025/2043] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:26.454736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.483585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.485847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.486483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.486945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.488553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.494033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.534015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1019/2044] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:26.536075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.547930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:26.552144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc22b4a-3685-4109-95bb-9bdc89bf0c95 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.559455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.560269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.560782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.561339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.562318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.564098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.581765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1020/2045] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:26.582705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.583195 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:26.585032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:26.600337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2656a4-0ada-46ce-84c4-3bbd3cb8efd0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.601388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc37627-91c8-48df-b207-3fd14216e49d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.607814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.608645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.609069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.609254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.609557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.609973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.610262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.610508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.610625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] PATH_INFO: `/v3/users/563d52b6ccf44064b329795a7fe8f73a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.611762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=563d52b6ccf44064b329795a7fe8f73a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.613456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.613870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.668831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1026/2046] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:26.670463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.685089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563d52b6ccf44064b329795a7fe8f73a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:26.686075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563d52b6ccf44064b329795a7fe8f73a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:26.700550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563d52b6ccf44064b329795a7fe8f73a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:26.713261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563d52b6ccf44064b329795a7fe8f73a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:26.715302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563d52b6ccf44064b329795a7fe8f73a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:26.769603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1021/2047] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:26 2022] DELETE /identity/v3/users/563d52b6ccf44064b329795a7fe8f73a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:26.771198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.773346 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:26.796447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc83c-fe52-42dd-b355-166ce35075c2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.908577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38d7b-fb3f-445d-a031-9c491326fe5e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.914501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.915281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.916305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.916744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.917335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.917811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.918051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.918386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.918663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.919362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.920186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.922020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4e4e-ffad-473a-a3e8-29964f1793fe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.943722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1022/2048] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:26.945158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1027/2049] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:26.946849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.947139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.947419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.948104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.958285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267dd66-d7c4-4549-b0df-e0e113293b77 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.963608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.964338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:26.964623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:26.964896 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:26.965631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:26.967262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:26.967377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:26.968528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:26.976874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1028/2050] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:26.977736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.981095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1023/2051] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:26.982993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:26.983934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:26.994415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcd04-e7f2-4f49-bcb8-05acd761a98e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.996417 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ff9f-3652-465e-80a9-ce8338cb66d8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:26.999098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:26.999771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.000053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.000332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] PATH_INFO: `/v3/projects/21f56352225c4906a605fb208d86c13f/users/8ce44f61e02a49e3ae53e8a54535ae71/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.001375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.002141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.002455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.002699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] PATH_INFO: `/v3/projects/1590e83c55b84a69892b03302f112ef8/users/025a421ea6e64c26a593a848cad6e737/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.018824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f56352225c4906a605fb208d86c13f, user_id=8ce44f61e02a49e3ae53e8a54535ae71, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.019886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1590e83c55b84a69892b03302f112ef8, user_id=025a421ea6e64c26a593a848cad6e737, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.021527 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.022608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.036508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1029/2052] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:26 2022] PUT /identity/v3/projects/1590e83c55b84a69892b03302f112ef8/users/025a421ea6e64c26a593a848cad6e737/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:27.037349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1024/2053] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:26 2022] PUT /identity/v3/projects/21f56352225c4906a605fb208d86c13f/users/8ce44f61e02a49e3ae53e8a54535ae71/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:27.041197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.041966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.047991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.066807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:27.105248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:27.109200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0902ab2-8ec4-4182-aa48-33462de953ab admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.114257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.114888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.115168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.115445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.116834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431564-1d49-4cea-862e-0a364db6114f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.186474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.187310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.187712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.188239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.189093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.190927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.191055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.192369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fffbbe-af40-4645-a3ab-1b515e9241d1 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.202997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1025/2054] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:27.203648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1030/2055] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:27.205165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1974-e148-49be-822c-cc426440d476 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.205584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1974-e148-49be-822c-cc426440d476 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.205791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1974-e148-49be-822c-cc426440d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.207278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.218552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37f75e-1bc4-4e32-be3e-3031324ad0ac admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.223842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.224517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.224798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.225077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] PATH_INFO: `/v3/projects/21f56352225c4906a605fb208d86c13f/users/8ce44f61e02a49e3ae53e8a54535ae71/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.227101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f56352225c4906a605fb208d86c13f, user_id=8ce44f61e02a49e3ae53e8a54535ae71, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.231536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47731562-a34f-4f67-9b89-093699a8289d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.250437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-856f1974-e148-49be-822c-cc426440d476 None None] MFA Rules not processed for user `025a421ea6e64c26a593a848cad6e737`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:27.251923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-856f1974-e148-49be-822c-cc426440d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.254950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1026/2056] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:27 2022] PUT /identity/v3/projects/21f56352225c4906a605fb208d86c13f/users/8ce44f61e02a49e3ae53e8a54535ae71/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:27.266996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.267319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.267561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.304212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] MFA Rules not processed for user `8ce44f61e02a49e3ae53e8a54535ae71`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:27.305979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.366472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1031/2057] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:27.379861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1974-e148-49be-822c-cc426440d476 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.382290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-856f1974-e148-49be-822c-cc426440d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.418643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1027/2058] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:27.435146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.436913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.479184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1974-e148-49be-822c-cc426440d476 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.482931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.483559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.483839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.484115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.496101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:27.498877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.501055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.529832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1032/2059] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:27.536939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581f7c8-2096-4939-94bc-de6dcde03f04 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.542245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.545683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.545683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.545683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.556631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.558979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.575985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1028/2060] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:27.642192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.652138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b67dd-dc7a-455b-bb5f-93d53cb860d7 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.656296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.659113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.660766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.661550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.661931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.662287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.664356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:27.722811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:27.743343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57c20-0e71-4571-9132-80875eb131b2 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.751086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.751788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.751999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.752275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] PATH_INFO: `/v3/projects/97eee4867dfd4ee6a22fd191d579cf6c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.753491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97eee4867dfd4ee6a22fd191d579cf6c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.756229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.762966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:27.765040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:27.777309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1033/2061] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:27.835097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97eee4867dfd4ee6a22fd191d579cf6c', 'request_id': 'req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:27.847558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97eee4867dfd4ee6a22fd191d579cf6c', 'request_id': 'req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:27.857183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97eee4867dfd4ee6a22fd191d579cf6c', 'request_id': 'req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:27.871324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] The token cache is being invalidate because project 97eee4867dfd4ee6a22fd191d579cf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:27.871619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:27.872288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:27.874603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1029/2062] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:27 2022] DELETE /identity/v3/projects/97eee4867dfd4ee6a22fd191d579cf6c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:27.878749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:27.898267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0c193-267d-4ca3-88f3-d6faa61fdd66 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:27.996489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:27.997119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:27.997553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:27.997904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] PATH_INFO: `/v3/users/b9ffff0af3674435948d2a3a321106ed` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:27.999679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ffff0af3674435948d2a3a321106ed)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.001884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.082076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ffff0af3674435948d2a3a321106ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.082758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ffff0af3674435948d2a3a321106ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.092651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ffff0af3674435948d2a3a321106ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.093477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ffff0af3674435948d2a3a321106ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.111696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d7e3b26f-8dfe-4ddd-84c6-eac9e526c98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ffff0af3674435948d2a3a321106ed'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.126085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1034/2063] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:27 2022] DELETE /identity/v3/users/b9ffff0af3674435948d2a3a321106ed => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:28.427469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:28.429122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:28.455337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a7b6d-5e8d-4974-b3f6-fa38c4f8f3a8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:28.526640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:28.527420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.527763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.528104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] PATH_INFO: `/v3/projects/2771cb3b3f9a4164ad00a85356164e98` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.529459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2771cb3b3f9a4164ad00a85356164e98)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.531411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.543050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:28.585254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2771cb3b3f9a4164ad00a85356164e98', 'request_id': 'req-efe16497-3e7b-450c-bb9b-e9b81954289e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.593722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2771cb3b3f9a4164ad00a85356164e98', 'request_id': 'req-efe16497-3e7b-450c-bb9b-e9b81954289e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.600377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2771cb3b3f9a4164ad00a85356164e98', 'request_id': 'req-efe16497-3e7b-450c-bb9b-e9b81954289e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.618049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] The token cache is being invalidate because project 2771cb3b3f9a4164ad00a85356164e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:28.618360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.619135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-efe16497-3e7b-450c-bb9b-e9b81954289e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:28.620839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1030/2064] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:28 2022] DELETE /identity/v3/projects/2771cb3b3f9a4164ad00a85356164e98 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:28.626920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.627212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.627491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.648699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:28.650535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:28.701409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:28.722624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1035/2065] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:28.731515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.731914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.732381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.755290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:28.756512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:28.765488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1031/2066] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:28.769835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:28.780676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20459e-0051-4328-a2d3-b5946388c6e3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:28.786002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:28.786623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.787068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.787412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.788151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:28.788460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.790123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.802549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1036/2067] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:28.807459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:28.817217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097adb-be58-4f92-a0eb-cd8483e9c2b4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:28.822642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:28.823311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.823594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.823871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.824543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.826480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.858613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1032/2068] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:28 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:28.862799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:28.872942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd5c07-6abf-41bc-b66d-3b6523ed2236 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:28.932504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:28.933127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.933408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.933766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.934433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.936344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.959046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1037/2069] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:28 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:28.964752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:28.975170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8ce5-e2b7-4266-a07d-fd676e54ff04 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:28.980160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:28.980771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:28.981050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:28.981323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:28.982157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:28.983793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:28.997721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1033/2070] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:28.998844 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:29.011445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab769e2-caa3-479b-a816-ec586cfcfb1c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:29.017030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:29.017739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:29.018022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:29.018301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:29.019013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:29.020676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea62b-1b2d-49c0-ba61-f09ef6d96aa0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:29.034874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1038/2071] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:29.039452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:29.050207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e524-2754-4cd5-973b-14b1c62654ce admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:29.055163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:29.055829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:29.056794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:29.057094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] PATH_INFO: `/v3/projects/0e56e57db24447d98efade34084824f7/users/fa6fe2881b1549ef8af48fa79978365f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:29.074013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e56e57db24447d98efade34084824f7, user_id=fa6fe2881b1549ef8af48fa79978365f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:29.076698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:29.092992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1034/2072] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:29 2022] PUT /identity/v3/projects/0e56e57db24447d98efade34084824f7/users/fa6fe2881b1549ef8af48fa79978365f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:29.105438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7e1a-b6c4-4cc5-ae39-3250993f5fab None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:29.105897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7e1a-b6c4-4cc5-ae39-3250993f5fab None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:29.106183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7e1a-b6c4-4cc5-ae39-3250993f5fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:29.139053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-793f7e1a-b6c4-4cc5-ae39-3250993f5fab None None] MFA Rules not processed for user `fa6fe2881b1549ef8af48fa79978365f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:29.140469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-793f7e1a-b6c4-4cc5-ae39-3250993f5fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:29.233243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1039/2073] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:29.247458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:29.248884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:29.392190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c33f3-2763-4942-bb73-4e1b6b87dc6a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:29.396306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:29.397131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:29.397437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:29.397725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:29.406839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:29.408362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd53e-03b0-4594-86a3-751b13de4e49 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:29.424169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1035/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:33.312794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:33.313361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:33.313527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:33.315199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1040/2075] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:47:33.340508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:33.341021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:33.341098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:33.362191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:33.363342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:33.381026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:33.388129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:33.390984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:33.447278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1036/2076] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:47:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:33.458229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:33.459282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:33.462436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:33.478368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47a12d-0f62-428c-be40-35abe2c37566 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:33.484717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:33.485554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:33.485837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:33.486144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:33.490895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee49e5d-3699-4e06-b69c-69dcb8c2d2bb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:33.496191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:33.497723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:33.497850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:33.498900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:33.498900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:33.499153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] PATH_INFO: `/v3/users/966689d952e14c1fb9007f2bdd7f03d3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:33.500532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] RBAC: Authorizing `identity:delete_user(user_id=966689d952e14c1fb9007f2bdd7f03d3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:33.502609 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:33.510766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1037/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:33.567715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966689d952e14c1fb9007f2bdd7f03d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.568353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966689d952e14c1fb9007f2bdd7f03d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.582459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966689d952e14c1fb9007f2bdd7f03d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.583147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966689d952e14c1fb9007f2bdd7f03d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.598774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-aab6aaeb-14d5-48b6-9fe8-7afd2a0e995a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966689d952e14c1fb9007f2bdd7f03d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.618862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1041/2078] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:33 2022] DELETE /identity/v3/users/966689d952e14c1fb9007f2bdd7f03d3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:33.814394 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:33.829080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ce99-33d9-41f0-8519-6f3a7dfa481b service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:33.905899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:33.906581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:33.906863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:33.907140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] PATH_INFO: `/v3/projects/3261a30431d343a1bb170b67199c0903` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:33.908308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3261a30431d343a1bb170b67199c0903)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:33.910479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:33.961779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3261a30431d343a1bb170b67199c0903', 'request_id': 'req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.969736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3261a30431d343a1bb170b67199c0903', 'request_id': 'req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:33.982899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3261a30431d343a1bb170b67199c0903', 'request_id': 'req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.002415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] The token cache is being invalidate because project 3261a30431d343a1bb170b67199c0903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:34.002635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.003271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.004951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1038/2079] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:33 2022] DELETE /identity/v3/projects/3261a30431d343a1bb170b67199c0903 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:34.009761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013582bb-913e-42a8-921d-1c0e9666464a None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.010059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013582bb-913e-42a8-921d-1c0e9666464a None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.010342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013582bb-913e-42a8-921d-1c0e9666464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.031595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-013582bb-913e-42a8-921d-1c0e9666464a None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:34.032838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-013582bb-913e-42a8-921d-1c0e9666464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.107254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.108967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.125566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1042/2080] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:34.129915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aaabe-a3bb-4141-aaa4-1a43e22a0d29 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.132630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.133293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.134604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.136267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.137540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.137822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.138199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] PATH_INFO: `/v3/users/dbfda3fadd81431aafd614533c84d830` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.139522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfda3fadd81431aafd614533c84d830)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.145910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.160606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:34.162061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.171513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1043/2081] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:34.176683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.199170 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc416-8ac7-45db-af44-22215fcb39ce None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.206668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:34.208354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.209168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.209556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.209988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.210796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:34.211291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.214277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.232309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1044/2082] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:34.236475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.246380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfda3fadd81431aafd614533c84d830'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.248004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfda3fadd81431aafd614533c84d830'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.251755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ba10-5b96-4d74-908c-eab7ffb7e26b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.261089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfda3fadd81431aafd614533c84d830'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.269522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.270699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.271169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.271668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.273327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.276117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.287876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfda3fadd81431aafd614533c84d830'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.289380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-98200ebe-e7bf-4d0c-aa07-971b2250f5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfda3fadd81431aafd614533c84d830'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.314430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1045/2083] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:34.318826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.322542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.331252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1039/2084] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:34 2022] DELETE /identity/v3/users/dbfda3fadd81431aafd614533c84d830 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:34.338197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.338626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.339112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.354930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:34.360881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:34.362390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.396936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc952e0-054c-47ba-a202-63933de25184 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.424824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1040/2085] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:34.435612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.437099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.466433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.467063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.467624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.467624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.468292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.470284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.496708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1046/2086] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:34.500440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.503357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbcc9b-1b3f-438b-95f6-78a328700448 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.507161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.507779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.508055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.508327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.511207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb337c1-2a84-44ec-80e1-84e6000c362f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.516255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.516956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.517234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.517601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.518312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.519486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.519921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.520977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.531176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1041/2087] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:34.531933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1047/2088] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:34.536057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.547418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb456c9-08c1-4e37-8691-bfbfeb2fbda1 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.553298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.554063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.554372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.554637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.555464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.557835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad56977-2d3c-4e80-8705-22fa886935df admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.568565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1042/2089] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:34.573987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.584746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca83ce-b8ff-4452-a7af-edaddc7d5007 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.590015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.590902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.591179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.591451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] PATH_INFO: `/v3/projects/c7f73dbe76c44777a3957079b9383a17/users/87cd0c17b6a345cfa464084e582fc710/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.612460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f73dbe76c44777a3957079b9383a17, user_id=87cd0c17b6a345cfa464084e582fc710, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.615749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.630989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1048/2090] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:34 2022] PUT /identity/v3/projects/c7f73dbe76c44777a3957079b9383a17/users/87cd0c17b6a345cfa464084e582fc710/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:34.636090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.636772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.637067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.657520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:34.658755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.696008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:34.730245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1043/2091] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:34.740300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.801927 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abea9-5dbc-4d42-9aa6-ac80c7f836b2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.805871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.806492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.807075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.807602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.823429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.825470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.830108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.831571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:34.836523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1049/2092] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:34.852097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6062-938a-404f-902b-b3207e54bf51 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.858051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:34.858703 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:34.859012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:34.859352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] PATH_INFO: `/v3/projects/25234e11a1004ee6ae9a9e761646e35b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:34.860470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25234e11a1004ee6ae9a9e761646e35b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:34.862384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:34.924183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25234e11a1004ee6ae9a9e761646e35b', 'request_id': 'req-69cad7c1-3827-4a96-b689-77b4131fb481'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.931046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25234e11a1004ee6ae9a9e761646e35b', 'request_id': 'req-69cad7c1-3827-4a96-b689-77b4131fb481'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.937623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25234e11a1004ee6ae9a9e761646e35b', 'request_id': 'req-69cad7c1-3827-4a96-b689-77b4131fb481'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.952326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] The token cache is being invalidate because project 25234e11a1004ee6ae9a9e761646e35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:34.952730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.953472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-69cad7c1-3827-4a96-b689-77b4131fb481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:34.955010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1044/2093] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:34 2022] DELETE /identity/v3/projects/25234e11a1004ee6ae9a9e761646e35b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:34.959102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:34.970187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b704f3-d8c5-4b0f-a5a7-d9f31ed72e82 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:34.998439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:35.045962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:35.046632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:35.046907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:35.047173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] PATH_INFO: `/v3/users/a44e059997a240f68829c2484e567848` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:35.048342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44e059997a240f68829c2484e567848)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:35.051168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:35.102307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44e059997a240f68829c2484e567848'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:35.103338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44e059997a240f68829c2484e567848'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:35.115464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44e059997a240f68829c2484e567848'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:35.116129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44e059997a240f68829c2484e567848'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:35.133310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44e059997a240f68829c2484e567848'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:35.147541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1050/2094] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:34 2022] DELETE /identity/v3/users/a44e059997a240f68829c2484e567848 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:35.780607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:35.781155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:35.781392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:35.803614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:35.813327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:35.833185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] MFA Rules not processed for user `87cd0c17b6a345cfa464084e582fc710`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:35.835295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:35.932289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8738-81b4-4655-abee-57dbc13bb60e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:35.938217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1045/2095] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:35.942425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:35.942891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:35.943116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:35.943361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:35.943634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] PATH_INFO: `/v3/projects/9764b7f5160e41c49c91cc2510e54f69` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:35.945035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9764b7f5160e41c49c91cc2510e54f69)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:35.945148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:35.947644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:35.961395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962264-ff55-4980-a511-a0d75439c3bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:35.967091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:35.968179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:35.968688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:35.968976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:35.969749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:35.971831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.005493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1046/2096] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:35 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:36.005716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:36.006491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9764b7f5160e41c49c91cc2510e54f69', 'request_id': 'req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.007735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.014515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9764b7f5160e41c49c91cc2510e54f69', 'request_id': 'req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.022585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9764b7f5160e41c49c91cc2510e54f69', 'request_id': 'req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.034699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] The token cache is being invalidate because project 9764b7f5160e41c49c91cc2510e54f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:36.034989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.035624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.037137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1051/2097] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:35 2022] DELETE /identity/v3/projects/9764b7f5160e41c49c91cc2510e54f69 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:36.040811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:36.041853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.043679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.079252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d7c2-31fb-4a41-afcc-d85781a36d63 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.084067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.084717 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.084996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.085277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.085969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.088446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.110504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1047/2098] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:36 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:36.114610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.116225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.124665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39d3f1-84ba-4f2f-a75b-c23c8df7acd1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.128701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c37b9-966f-4dc4-b8b6-13a6c35ba227 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.129358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.130030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.130312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.130588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] PATH_INFO: `/v3/users/8ce44f61e02a49e3ae53e8a54535ae71` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.131764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce44f61e02a49e3ae53e8a54535ae71)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.133579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.133744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.134732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.135043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.135398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.136098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.138605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.155272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1048/2099] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:36.156286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.166800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9149f4-948e-47c6-bcef-bab36cc3f27f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.172903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.173674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.173990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.174323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] PATH_INFO: `/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11/users/c1b953eb366b48378e39e3036706dc51/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.186427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce44f61e02a49e3ae53e8a54535ae71'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.187109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce44f61e02a49e3ae53e8a54535ae71'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.195340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce44f61e02a49e3ae53e8a54535ae71'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.196264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce44f61e02a49e3ae53e8a54535ae71'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.199249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffd2a55d86a4af1bebaeb2411a99f11, user_id=c1b953eb366b48378e39e3036706dc51, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.201950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.210953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce44f61e02a49e3ae53e8a54535ae71'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.215578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1049/2100] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:36 2022] PUT /identity/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11/users/c1b953eb366b48378e39e3036706dc51/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:36.219641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.221903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.227368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1052/2101] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:36 2022] DELETE /identity/v3/users/8ce44f61e02a49e3ae53e8a54535ae71 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:36.297021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59454a-b34d-4da6-9272-2fe1239b7d88 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.361384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.362121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.362410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.362693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.363424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.365025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.376403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1050/2102] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:36.380895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.392899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac04bd-9f55-4073-a9af-3183236a70c8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.398886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.399793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.400067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.400410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] PATH_INFO: `/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11/users/c1b953eb366b48378e39e3036706dc51/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.402658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffd2a55d86a4af1bebaeb2411a99f11, user_id=c1b953eb366b48378e39e3036706dc51, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.405452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.417028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1053/2103] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:36 2022] PUT /identity/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11/users/c1b953eb366b48378e39e3036706dc51/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:36.543741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.545640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.561507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.562415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01166a7-8e0f-4028-83d3-2381ad83a1db admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.564357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.629286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:36.663970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:36.695777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.696078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e01f-63f2-476b-98da-1c9404091e54 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:36.697699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.698308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.698763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] PATH_INFO: `/v3/users/025a421ea6e64c26a593a848cad6e737` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.700443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=025a421ea6e64c26a593a848cad6e737)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.702392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:36.702855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.703223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.703581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.703938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] PATH_INFO: `/v3/projects/21f56352225c4906a605fb208d86c13f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.705293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f56352225c4906a605fb208d86c13f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:36.708109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:36.789409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f56352225c4906a605fb208d86c13f', 'request_id': 'req-a18307d3-6b57-4a40-8a5a-248713b8db8b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.791972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025a421ea6e64c26a593a848cad6e737'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.792914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025a421ea6e64c26a593a848cad6e737'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.797972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f56352225c4906a605fb208d86c13f', 'request_id': 'req-a18307d3-6b57-4a40-8a5a-248713b8db8b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.802307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025a421ea6e64c26a593a848cad6e737'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.811196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f56352225c4906a605fb208d86c13f', 'request_id': 'req-a18307d3-6b57-4a40-8a5a-248713b8db8b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.814422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025a421ea6e64c26a593a848cad6e737'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.815674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9ec64008-0aa0-4835-89fe-505ecabebc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025a421ea6e64c26a593a848cad6e737'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.829596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] The token cache is being invalidate because project 21f56352225c4906a605fb208d86c13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:36.831694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.832545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a18307d3-6b57-4a40-8a5a-248713b8db8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:36.837593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1054/2104] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:36 2022] DELETE /identity/v3/projects/21f56352225c4906a605fb208d86c13f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:36.842227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.842932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.843679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.857729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1051/2105] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:36 2022] DELETE /identity/v3/users/025a421ea6e64c26a593a848cad6e737 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:36.859374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ebca-63ff-4d44-852c-282603355586 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.859916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ebca-63ff-4d44-852c-282603355586 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.860266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ebca-63ff-4d44-852c-282603355586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.881404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:36.882668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.890358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3270ebca-63ff-4d44-852c-282603355586 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:36.891696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3270ebca-63ff-4d44-852c-282603355586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:36.983823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1055/2106] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:36.984469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1052/2107] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:36.992827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:36.992827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:36.992827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:36.997496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:36.999501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.018367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:37.019745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.035923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1053/2108] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:37.039614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.056100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe658-6bd2-48d9-af65-720efecdffb7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.066987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.067789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.068019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.068348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.070022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:37.070192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.074467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.085055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49209d-9cb9-4a47-adec-03b01163209b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.090596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.091234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.091514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.091788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.098663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1054/2109] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:37.099828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.107879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.108849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.119800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1056/2110] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:37.132984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a397-8c92-4a92-8f26-b0c0d07bfa32 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.155613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.156256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.156539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.156814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.157908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.159413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.208218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1055/2111] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:37.216184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.234666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921814e7-7cfc-402c-a7dd-152db6e746ee service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.253572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:37.336670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.337968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.338426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.338954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.343491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.345752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.375570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1057/2112] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:37.377618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.387613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:37.394791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a8b42-ef27-49be-b638-ffde3976c912 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.404304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.405243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.405243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.405558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.406478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.409472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.427407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1056/2113] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:37.428622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.439667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faab47-58ae-4618-8919-7651761e88f2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.450057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.451030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.451807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.452284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.453174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.454995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.466962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1058/2114] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:37.470963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.485064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06657d1b-7f8c-4770-b729-d04bb62d9779 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.498068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.498874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.499341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.499661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] PATH_INFO: `/v3/projects/da72b0db8a954aa5bf6fd46607f34711/users/95bf79bf8ca34034bd15ea9b9a82801b/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.515634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.518473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.539907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c9f4-08f4-4fcc-861f-72e6f1fd2664 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.546464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.546952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da72b0db8a954aa5bf6fd46607f34711, user_id=95bf79bf8ca34034bd15ea9b9a82801b, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.547082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.547300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.547573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] PATH_INFO: `/v3/projects/1590e83c55b84a69892b03302f112ef8` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.549274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1590e83c55b84a69892b03302f112ef8)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.551636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.555807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979e27-d6cb-4b30-ad7b-e1eeb80a1e30 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.583852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1057/2115] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:37 2022] PUT /identity/v3/projects/da72b0db8a954aa5bf6fd46607f34711/users/95bf79bf8ca34034bd15ea9b9a82801b/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:37.599275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07659a-5b90-4bb0-b71f-6580e4cf5d36 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.599976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07659a-5b90-4bb0-b71f-6580e4cf5d36 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.601393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07659a-5b90-4bb0-b71f-6580e4cf5d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.651149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1590e83c55b84a69892b03302f112ef8', 'request_id': 'req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:37.657226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1590e83c55b84a69892b03302f112ef8', 'request_id': 'req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:37.669000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1590e83c55b84a69892b03302f112ef8', 'request_id': 'req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:37.669441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ef07659a-5b90-4bb0-b71f-6580e4cf5d36 None None] MFA Rules not processed for user `95bf79bf8ca34034bd15ea9b9a82801b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:37.670917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef07659a-5b90-4bb0-b71f-6580e4cf5d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.690062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] The token cache is being invalidate because project 1590e83c55b84a69892b03302f112ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:37.693689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:37.695849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91dc453d-0d77-4bd7-a7fe-5dab1cd735f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:37.697489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1059/2116] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:37 2022] DELETE /identity/v3/projects/1590e83c55b84a69892b03302f112ef8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:37.698709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.698986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.699258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.738193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] MFA Rules not processed for user `c1b953eb366b48378e39e3036706dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:37.739428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.763836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1058/2117] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:37.765068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e3a3-8310-45e3-9a3e-08bfa7982d57 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.765366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e3a3-8310-45e3-9a3e-08bfa7982d57 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.765687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e3a3-8310-45e3-9a3e-08bfa7982d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.788079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5b39e3a3-8310-45e3-9a3e-08bfa7982d57 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:37.789871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5b39e3a3-8310-45e3-9a3e-08bfa7982d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.834343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1060/2118] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:37.835094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.840719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.847427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:37.866999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1059/2119] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:37.876349 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.876807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.877194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.899790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:37.905541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:37.918132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1060/2120] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:37.922288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.932078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4441ef5-f4fe-492f-9f6c-44b83ed6af6b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.935010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ff61-661b-4bf2-b797-d1f2c4b2689d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.937239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.937902 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.938247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.938446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.939158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:37.939464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.941092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.943084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:37.944185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:37.944418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:37.944697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:37.945361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:37.948013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:37.966519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1061/2121] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:47:37.967749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:37.979352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553611f-499a-4c38-896a-38c10cd31b9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:37.981306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1061/2122] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:37.985612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.030487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:38.060174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.060938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.061286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.061607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.062292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.064287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.076633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135621e-80b5-4483-986a-2c69c7c5be78 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.082238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.082942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.083314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.083891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.084643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.087452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.096075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1062/2123] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:38.100678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.111899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1062/2124] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:37 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:38.115954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.128448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea340b6-e66f-4de7-9ec0-a82411d6cd2b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.189126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfe5ab-78c7-4a2f-8a2d-f77c49980d9c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.198601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.199256 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.199543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.199826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.200507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.202498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.213451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.214480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.214667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.215103 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.216099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.220099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.235799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1063/2125] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:38 2022] POST /identity/v3/users => generated 281 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:38.236011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1063/2126] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:38.237173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.238560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.248160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d91bf-630f-45d3-af0b-2c3bd8c9d74c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.254815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5f28-e824-413b-8048-ef55259542e7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.257933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.258880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.259237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.259623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] PATH_INFO: `/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c/users/5c8ac182d3aa478e8d1ef353df1ba404/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.260432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.261109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.261392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.262059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.262787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.264430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.274123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:38.280641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1064/2127] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:38.281487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.283538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b480d6c2e9654a13912bc9a3dd4f5c2c, user_id=5c8ac182d3aa478e8d1ef353df1ba404, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.286553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.292662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acaf10-a05f-41b0-9f82-e8f862268fd5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.303248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.304502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.304789 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.305068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.305828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.307583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.308015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1064/2128] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:38 2022] PUT /identity/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c/users/5c8ac182d3aa478e8d1ef353df1ba404/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:38.313128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.322951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1065/2129] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:38.327149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.345216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deafc8-f390-4b85-b8a2-2026dd58650d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.411348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a549e8-a4a4-4763-b897-4516771d7ca3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.415323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.416207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.416333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.416563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.416878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.416977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] PATH_INFO: `/v3/projects/b7083acedab54115a19c142dd09fbd72/users/1eedc1b6b282472981c083e7aaba37ca/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.417160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.417492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.418312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.420028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.431243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1065/2130] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:38.434798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7083acedab54115a19c142dd09fbd72, user_id=1eedc1b6b282472981c083e7aaba37ca, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.437064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.437781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae0c37-f449-402a-a69a-1696a16d79ab admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.448742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d88e-58db-42ec-aad7-a637c84be82b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.458391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1066/2131] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:38 2022] PUT /identity/v3/projects/b7083acedab54115a19c142dd09fbd72/users/1eedc1b6b282472981c083e7aaba37ca/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:38.470302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.470598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.470877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.498957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:38.502268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] MFA Rules not processed for user `1eedc1b6b282472981c083e7aaba37ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:38.504462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:38.542068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.542679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.542994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.543276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] PATH_INFO: `/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c/users/5c8ac182d3aa478e8d1ef353df1ba404/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.552902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b480d6c2e9654a13912bc9a3dd4f5c2c, user_id=5c8ac182d3aa478e8d1ef353df1ba404, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.554795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57f12-f3ba-4296-b54b-8228c0b4f1df admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.572181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1066/2132] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:38 2022] PUT /identity/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c/users/5c8ac182d3aa478e8d1ef353df1ba404/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:38.582887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.583401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.583833 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.587261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1067/2133] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:38.622733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.623681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] MFA Rules not processed for user `5c8ac182d3aa478e8d1ef353df1ba404`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:38.624168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:38.625206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:38.714324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d92fd-f6a5-4648-a7fd-036bcbeb1b16 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.719579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1067/2134] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:38.775493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.776746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.777208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.777493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.780965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.783497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:38.794997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:38.799439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89468e88-5d81-4368-9774-998a62fea4cc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:38.806541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:38.808470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.808765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.809040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.849660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.851322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02fd98-9f20-4ded-9724-3f16f28a0a36 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.863898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1068/2135] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:38.865186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6c6a-32dc-4963-9e56-99e91281870d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.865556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6c6a-32dc-4963-9e56-99e91281870d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.865844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed6c6a-32dc-4963-9e56-99e91281870d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.867344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1069/2136] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:47:38.879658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:38.888398 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:38.891223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:38.891586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:38.891708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:38.902328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1068/2137] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:38.903153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:38.922874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] MFA Rules not processed for user `66151da3fa3a4bdb8816f74c7c434caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:38.924088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:38.936408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:39.000086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28d2a-8f86-4c76-8976-a41d7ecabd7d service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:39.007276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:39.007869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:39.008154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:39.008428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] PATH_INFO: `/v3/users/1eedc1b6b282472981c083e7aaba37ca` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:39.010807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eedc1b6b282472981c083e7aaba37ca)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:39.013356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:39.039243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1070/2138] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:39.060372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:39.062329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:39.081716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e82a-d755-4df3-b824-9c8b8fe1d629 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:39.086050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eedc1b6b282472981c083e7aaba37ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.086853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eedc1b6b282472981c083e7aaba37ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.089525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:39.090303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:39.090692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:39.091073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:39.097936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eedc1b6b282472981c083e7aaba37ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.098998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eedc1b6b282472981c083e7aaba37ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.108566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:39.110635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8586f9-d499-440d-a885-c9a431cd8e5c service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:39.119976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eedc1b6b282472981c083e7aaba37ca'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.127438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1071/2139] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:39.144255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1069/2140] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:38 2022] DELETE /identity/v3/users/1eedc1b6b282472981c083e7aaba37ca => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:39.149953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:39.150288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:39.150556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:39.178225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:39.180038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:39.262122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1072/2141] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:39.275943 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:39.277584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:39.308416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:39.366456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dacfc-7ad4-4103-be5d-771b25317243 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:39.390415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:39.391378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:39.392284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:39.394450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:39.408287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:39.420962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:39.453768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1070/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:39.645198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:39.646766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:39.660227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e653918-46bb-459b-a9b8-b4b7f85782bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:39.666843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:39.667766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:39.668054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:39.668292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] PATH_INFO: `/v3/users/87cd0c17b6a345cfa464084e582fc710` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:39.669658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cd0c17b6a345cfa464084e582fc710)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:39.671778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:39.749943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cd0c17b6a345cfa464084e582fc710'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.764750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cd0c17b6a345cfa464084e582fc710'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.772397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cd0c17b6a345cfa464084e582fc710'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.783148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cd0c17b6a345cfa464084e582fc710'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.783941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cd0c17b6a345cfa464084e582fc710'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:39.805305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1073/2143] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:39 2022] DELETE /identity/v3/users/87cd0c17b6a345cfa464084e582fc710 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:39.918895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:39.920598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:39.947831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1089-6006-4c5b-bfbf-1e1c27c5eab8 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.002108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.003700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.017319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:40.024045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.024421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.024847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.025126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] PATH_INFO: `/v3/projects/b7083acedab54115a19c142dd09fbd72` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.026538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7083acedab54115a19c142dd09fbd72)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.028890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.081203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7083acedab54115a19c142dd09fbd72', 'request_id': 'req-b10fe600-ddd6-4cc2-83d0-35f8948481f7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.085377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a245e9-f4f5-4713-9126-486cb168ea3d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.091030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7083acedab54115a19c142dd09fbd72', 'request_id': 'req-b10fe600-ddd6-4cc2-83d0-35f8948481f7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.103142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7083acedab54115a19c142dd09fbd72', 'request_id': 'req-b10fe600-ddd6-4cc2-83d0-35f8948481f7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.116237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] The token cache is being invalidate because project b7083acedab54115a19c142dd09fbd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:40.116531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.117172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-b10fe600-ddd6-4cc2-83d0-35f8948481f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.119478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1071/2144] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:39 2022] DELETE /identity/v3/projects/b7083acedab54115a19c142dd09fbd72 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:40.124127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393d96-f045-46ae-b8f4-31d6d32bc913 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.124416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393d96-f045-46ae-b8f4-31d6d32bc913 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.124697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393d96-f045-46ae-b8f4-31d6d32bc913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.145271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.145956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.146247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.146518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] PATH_INFO: `/v3/projects/c7f73dbe76c44777a3957079b9383a17` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.147119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-56393d96-f045-46ae-b8f4-31d6d32bc913 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:40.147687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f73dbe76c44777a3957079b9383a17)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.148370 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-56393d96-f045-46ae-b8f4-31d6d32bc913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.150314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.160674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1072/2145] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:40.168878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.169173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.169474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.196772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:40.198098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.203206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f73dbe76c44777a3957079b9383a17', 'request_id': 'req-fe548eb0-0d58-4f25-9bba-468345bd0785'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.210284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f73dbe76c44777a3957079b9383a17', 'request_id': 'req-fe548eb0-0d58-4f25-9bba-468345bd0785'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.216884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f73dbe76c44777a3957079b9383a17', 'request_id': 'req-fe548eb0-0d58-4f25-9bba-468345bd0785'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.228765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] The token cache is being invalidate because project c7f73dbe76c44777a3957079b9383a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:40.229446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.229756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.231288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1074/2146] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:40 2022] DELETE /identity/v3/projects/c7f73dbe76c44777a3957079b9383a17 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:40.235288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.236622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.255700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:40.272434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1073/2147] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:40.276663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.285783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7ee4a-2628-4766-99b7-83d55676fc02 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.289549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:40.290918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.291737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.292017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.292314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.293009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:40.293315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.294960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.311502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1074/2148] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:47:40.312565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.313380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe548eb0-0d58-4f25-9bba-468345bd0785 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.318292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.319210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.319496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.319776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] PATH_INFO: `/v3/users/c1b953eb366b48378e39e3036706dc51` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.321057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b953eb366b48378e39e3036706dc51)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.323744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.323869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852db10-ef34-41da-a478-40ce52202074 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.328507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.329105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.329386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.329690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.330375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.332307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.361998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1075/2149] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:40.365889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.376565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b953eb366b48378e39e3036706dc51'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.377281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b953eb366b48378e39e3036706dc51'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.385634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b953eb366b48378e39e3036706dc51'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.393536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b953eb366b48378e39e3036706dc51'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.394179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b953eb366b48378e39e3036706dc51'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.415591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1075/2150] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:40 2022] DELETE /identity/v3/users/c1b953eb366b48378e39e3036706dc51 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:40.435748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de702-ee8d-41bb-8519-81f2d8694777 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.511277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.512179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.512595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.512869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.513569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.515629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.542278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1076/2151] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:40.546382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.550466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.584359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bda1a-588e-42b2-b7f0-e74f3c183061 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.596169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.596906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.597788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.599773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.600678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.604145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.618018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.620261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.633203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1076/2152] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:40.638014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.638567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8adfb-cbc7-4800-bea6-8ec05a897160 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.652625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.653624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.653893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.654006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaaaa6-d032-4bff-b258-d0c4b516c8ee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.654167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] PATH_INFO: `/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.657243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffd2a55d86a4af1bebaeb2411a99f11)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.659329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.660201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.660695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.661354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.661718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.663369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.664159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.676988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1077/2153] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:40.680882 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.697002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb866e-734f-4891-8af2-f89cfc2a6719 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:40.704588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:40.705273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.705590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.705866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] PATH_INFO: `/v3/projects/4033eb3313cb4cc29c231508f0ece9d7/users/2ff7d1659e664ebfb6977581bf62fa6f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.730478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:40.732108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4033eb3313cb4cc29c231508f0ece9d7, user_id=2ff7d1659e664ebfb6977581bf62fa6f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:40.734476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffd2a55d86a4af1bebaeb2411a99f11', 'request_id': 'req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.736322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc61d-4489-4c8f-972a-8e70b621593b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:40.744069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffd2a55d86a4af1bebaeb2411a99f11', 'request_id': 'req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.764782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1078/2154] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:40 2022] PUT /identity/v3/projects/4033eb3313cb4cc29c231508f0ece9d7/users/2ff7d1659e664ebfb6977581bf62fa6f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:40.777852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.778974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffd2a55d86a4af1bebaeb2411a99f11', 'request_id': 'req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.780978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.780978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.796201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] The token cache is being invalidate because project 2ffd2a55d86a4af1bebaeb2411a99f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:40.796694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.798448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e3120daf-ddda-453d-a2fa-5b2db71b9fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:40.801106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1077/2155] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:40 2022] DELETE /identity/v3/projects/2ffd2a55d86a4af1bebaeb2411a99f11 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:40.806225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ea142-fb78-4c6a-88a1-250518fbade3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.806520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ea142-fb78-4c6a-88a1-250518fbade3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.806832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ea142-fb78-4c6a-88a1-250518fbade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:40.826555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] MFA Rules not processed for user `2ff7d1659e664ebfb6977581bf62fa6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:40.827884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.833752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4c0ea142-fb78-4c6a-88a1-250518fbade3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:40.835185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4c0ea142-fb78-4c6a-88a1-250518fbade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.918689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1079/2156] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:40.924187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:40.929243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:40.948278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:40.979144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1078/2157] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:40.987187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:40.987554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:40.987957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.012297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:41.014283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:41.023892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1079/2158] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:41.028629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.033367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2ef5-54ec-49ef-95d2-5a05a001791d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.038616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.038793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6c50-5167-4db7-80ad-06420adb36e4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.039250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.039533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.039810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.040950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.042841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.044210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.044887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.045231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.045603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.046372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:41.046733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.048574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.065119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1080/2159] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:47:41.069643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.076404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1080/2160] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:40 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:41.077316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.080596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4dc-7f42-4e8f-9a4b-408323c94dc3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.138224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.138756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.139036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.139307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.139967 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.141000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb8ad-3e7c-4db9-a568-323ba18391c1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.141917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.145691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.146315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.146593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.146869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.147535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.150009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.174638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1081/2161] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.174844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1081/2162] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.175626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.176189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.187588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b5ff-c3f1-4f5b-a6fa-b603728ffeb5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.221758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:41.248090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c128-ed6f-484c-a06d-53456e3f9a3c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.249391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.250049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.250332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.250609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.251303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.252913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.253178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.253829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.254113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.254385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.255102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.257012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.263870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1082/2163] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:41.268085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.284779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb957c5d-70a4-4097-a6ca-f5a97f6de300 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.287982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1082/2164] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.292029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.292199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.292749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.293132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.293499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.294264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.296403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.305029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613627f-ba68-4f7e-b845-ad361242e9db admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.312068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.313081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.313590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.314097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.315019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1083/2165] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:41.315537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.318983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.322112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.332548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51557-8ff9-4503-8287-0680901fb82b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.333036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1083/2166] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:41.336987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.340398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.341113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.341397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.341708 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] PATH_INFO: `/v3/projects/0ad73458aa1943908fb0bbe14b065cd9/users/ed2cf1570934437484de89e97c1d1efe/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.344887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:41.348037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9225b-250a-4d3a-a216-f42c15c00d58 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.353540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.354339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.354623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.354901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.355750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.357905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.358952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad73458aa1943908fb0bbe14b065cd9, user_id=ed2cf1570934437484de89e97c1d1efe, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.361904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4671ba-e03a-49eb-bb45-807a1aed65db admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.371875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1084/2167] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:41.375939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.376184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1084/2168] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:41 2022] PUT /identity/v3/projects/0ad73458aa1943908fb0bbe14b065cd9/users/ed2cf1570934437484de89e97c1d1efe/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:41.386815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f1c8-9780-48ba-b72e-83aa7f27f7a7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.389172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.389405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.389705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.417839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] MFA Rules not processed for user `ed2cf1570934437484de89e97c1d1efe`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:41.419062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:41.446993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.447675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.447960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.448241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] PATH_INFO: `/v3/projects/0380cc21181e40f9822d02780973d6df/users/9c849d2de8744ea993422ee76c060130/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.466181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0380cc21181e40f9822d02780973d6df, user_id=9c849d2de8744ea993422ee76c060130, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.468856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e56c3-8cb4-43c4-a1c0-c434d743c0ac admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.486702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1085/2169] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:41 2022] PUT /identity/v3/projects/0380cc21181e40f9822d02780973d6df/users/9c849d2de8744ea993422ee76c060130/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:41.497262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.497584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.497864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.501630 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1085/2170] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:41.505752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.518520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3132-5c4b-47db-b28e-8269ed8d313a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.531348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] MFA Rules not processed for user `9c849d2de8744ea993422ee76c060130`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:41.533248 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:41.592834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.593469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.593753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.594029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.594694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.596592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.603685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1086/2171] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:41.608027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.620187 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5376-adda-4565-bc48-7b002a3d71cd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.625075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.625728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.626009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.626282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.626949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.628420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1086/2172] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.628880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.632170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.654357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:41.667056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1087/2173] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.669373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.705178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175fb67-cf8a-429f-8807-1212f4c48967 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.709002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:41.737210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124363a-c263-4c81-be3f-e03c23b6f163 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.744122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.744739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.745022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.745296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.746020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.748039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.769328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1088/2174] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.773193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.773871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.775079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.775311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.775586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.776250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.778728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.784448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bcddc-2eea-4c80-a304-86fd44bf0356 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.789620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.790892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.791196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.791550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.792277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.793926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.805590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1087/2175] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:41 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:41.805757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1089/2176] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:41.806596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.808803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.816548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48cf4-5863-4b38-a446-6c4d3b1d2806 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.818640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a327d-203c-4d62-8fb4-b827e8adad86 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.822469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.823287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.823571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.823897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.824323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.824534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.824989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.825290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.825584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] PATH_INFO: `/v3/projects/5d1463def30d485fb2e8f2f1678320db/users/772872eb3fe14440ad3cf0c2986e6833/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.826163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.839431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1088/2177] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:41.842200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1463def30d485fb2e8f2f1678320db, user_id=772872eb3fe14440ad3cf0c2986e6833, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.843497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.845343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.856127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f900e7-d936-4cb1-bb10-3701336aa725 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.865912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1090/2178] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:41 2022] PUT /identity/v3/projects/5d1463def30d485fb2e8f2f1678320db/users/772872eb3fe14440ad3cf0c2986e6833/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:41.866933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.933471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.933471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.933471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.933471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] PATH_INFO: `/v3/projects/8b764be21ad4424d8e429a1105f953a9/users/c8ae61acc74c4e7ab6bf719e7c0811d1/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.942960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0f3b-b652-4e76-b1fa-20bb1892d321 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:41.949443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:41.950122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:41.950407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:41.950677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:41.951369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.953159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.963192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b764be21ad4424d8e429a1105f953a9, user_id=c8ae61acc74c4e7ab6bf719e7c0811d1, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:41.968053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1091/2179] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:41.969094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:41.973053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:41.990933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101172b-ff3e-402e-9867-27313a143a66 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.007906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1089/2180] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:41 2022] PUT /identity/v3/projects/8b764be21ad4424d8e429a1105f953a9/users/c8ae61acc74c4e7ab6bf719e7c0811d1/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:42.009319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.052875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:42.073060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.073848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.074156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.074434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] PATH_INFO: `/v3/projects/5d1463def30d485fb2e8f2f1678320db/users/772872eb3fe14440ad3cf0c2986e6833/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.079077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1463def30d485fb2e8f2f1678320db, user_id=772872eb3fe14440ad3cf0c2986e6833, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.081876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a615-6a6d-4248-adc6-d0ab6c818530 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.097085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1092/2181] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:41 2022] PUT /identity/v3/projects/5d1463def30d485fb2e8f2f1678320db/users/772872eb3fe14440ad3cf0c2986e6833/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:42.107225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42865-e45d-4da7-a1b0-e63822871247 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.109708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.110000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.110279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.123402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:42.145058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] MFA Rules not processed for user `772872eb3fe14440ad3cf0c2986e6833`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:42.146540 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.192661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.193733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.194778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.195142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.195926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.198443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.212773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1090/2182] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:42.217314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.228842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11dd1f-29e5-4436-9000-eb9af86262c2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.233820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.234498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.234783 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.235065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] PATH_INFO: `/v3/projects/8b764be21ad4424d8e429a1105f953a9/users/c8ae61acc74c4e7ab6bf719e7c0811d1/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.237060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b764be21ad4424d8e429a1105f953a9, user_id=c8ae61acc74c4e7ab6bf719e7c0811d1, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.239749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1789d-2ce8-4900-bebc-ce21251fdfcb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.249643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1093/2183] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:42.257507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.259732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1091/2184] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:42 2022] PUT /identity/v3/projects/8b764be21ad4424d8e429a1105f953a9/users/c8ae61acc74c4e7ab6bf719e7c0811d1/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:42.259865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.270088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.270457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.271492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.304460 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] MFA Rules not processed for user `c8ae61acc74c4e7ab6bf719e7c0811d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:42.306747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.330997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea1e3-9bc4-494f-995a-5b9282fa06cf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.397870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.398812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.399866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.400165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.414230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1092/2185] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:42.457102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:42.473665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.475178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.488769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54027c7-c429-4c48-a047-51d8a0384e0d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.492136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.492485 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.493699 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.494008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.494517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.494774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.506993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1094/2186] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:42.540970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.566366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.567826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d20617-4748-43e1-9686-9953be38d90b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.578168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1093/2187] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:42.605732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8f690-c042-4d09-a3eb-fa7e84627128 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.610589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.611229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.611508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.611778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] PATH_INFO: `/v3/users/9c849d2de8744ea993422ee76c060130` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.612945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c849d2de8744ea993422ee76c060130)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.614915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.669121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c849d2de8744ea993422ee76c060130'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:42.669792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c849d2de8744ea993422ee76c060130'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:42.678207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c849d2de8744ea993422ee76c060130'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:42.678829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c849d2de8744ea993422ee76c060130'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:42.692035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c849d2de8744ea993422ee76c060130'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:42.707380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1095/2188] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:42 2022] DELETE /identity/v3/users/9c849d2de8744ea993422ee76c060130 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:42.713031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.713332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.713640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.733760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:42.735070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.753689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:42.804808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1094/2189] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:42.815815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:42.817569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:42.893711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc661df9-6ee5-4b4f-b5d2-eec46c21c88a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:42.897782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:42.898497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:42.898795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:42.899086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:42.912633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:42.916455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:42.918842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:42.931355 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1096/2190] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:43.254829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:43.256265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:43.274906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6c44-81db-4d1d-8e2a-4a8324b7f783 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:43.281248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:43.281921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:43.282143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:43.282417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] PATH_INFO: `/v3/projects/0380cc21181e40f9822d02780973d6df` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:43.283574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0380cc21181e40f9822d02780973d6df)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:43.285569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:43.333408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0380cc21181e40f9822d02780973d6df', 'request_id': 'req-db6db1f5-37c2-4b85-99f9-626f39484e9d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.341751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0380cc21181e40f9822d02780973d6df', 'request_id': 'req-db6db1f5-37c2-4b85-99f9-626f39484e9d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.348659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0380cc21181e40f9822d02780973d6df', 'request_id': 'req-db6db1f5-37c2-4b85-99f9-626f39484e9d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.363313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] The token cache is being invalidate because project 0380cc21181e40f9822d02780973d6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:43.363601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.364224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.365770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1095/2191] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:43 2022] DELETE /identity/v3/projects/0380cc21181e40f9822d02780973d6df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:43.370274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:43.379822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b406-e982-474f-994e-a574a24b7c00 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:43.437854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:43.438494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:43.438788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:43.439056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] PATH_INFO: `/v3/users/772872eb3fe14440ad3cf0c2986e6833` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:43.440217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=772872eb3fe14440ad3cf0c2986e6833)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:43.442182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:43.492421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772872eb3fe14440ad3cf0c2986e6833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.493762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772872eb3fe14440ad3cf0c2986e6833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.502038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772872eb3fe14440ad3cf0c2986e6833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.503010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772872eb3fe14440ad3cf0c2986e6833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.518379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772872eb3fe14440ad3cf0c2986e6833'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:43.538345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1097/2192] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:43 2022] DELETE /identity/v3/users/772872eb3fe14440ad3cf0c2986e6833 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:43.627906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:43.629430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:43.700403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db1f5-37c2-4b85-99f9-626f39484e9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:43.765633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:43.766271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:43.766555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:43.766862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:43.768609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:43.784746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:43.844893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:43.846357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312834a1-dc9e-4ff5-be5c-d3a7a4d41c78 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:43.858442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1096/2193] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:43.869382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:43.871095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:43.950003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf1ca-0e97-412d-84d1-4cf7e8b4a780 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:43.956298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:43.956974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:43.959291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:43.959291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] PATH_INFO: `/v3/projects/5d1463def30d485fb2e8f2f1678320db` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:43.959291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1463def30d485fb2e8f2f1678320db)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:43.960905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:43.980204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:44.024956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1463def30d485fb2e8f2f1678320db', 'request_id': 'req-7af8c997-7a8c-41a1-909f-c98610769fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:44.032063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1463def30d485fb2e8f2f1678320db', 'request_id': 'req-7af8c997-7a8c-41a1-909f-c98610769fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:44.041443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1463def30d485fb2e8f2f1678320db', 'request_id': 'req-7af8c997-7a8c-41a1-909f-c98610769fe4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:44.054093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] The token cache is being invalidate because project 5d1463def30d485fb2e8f2f1678320db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:44.054388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:44.055047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-7af8c997-7a8c-41a1-909f-c98610769fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:44.060300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1098/2194] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:43 2022] DELETE /identity/v3/projects/5d1463def30d485fb2e8f2f1678320db => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:44.061677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.061972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.062247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.092560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:44.093953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:44.203197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1097/2195] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:44.204891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.205243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.205808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.236796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:44.238267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:44.257885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1099/2196] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:44.264912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.276162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efe4a6-8490-4406-8e70-0af35be6da73 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.282811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.283516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.283868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.284422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.285212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:44.285624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.288087 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.301701 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1098/2197] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:44.309099 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.317746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.320326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:44.320629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de865516-8e95-4a3a-afeb-51bc83bd0cbf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.327328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.328052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.328404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.328747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.329541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.332256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.374894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1100/2198] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:44.379172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.404330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f747-d632-418e-953c-5aaea17ec498 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.451545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4c64-add4-4d63-b2c2-7fa1c3e08382 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.456337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.456893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.457171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.457536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.458206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.460432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.464811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.465464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.465753 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.466028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.467846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:44.478356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:44.485523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1101/2199] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:44.490298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.504717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cdc6-d040-4b9e-a1ed-3360776dd3e7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.516861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.517549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.517834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.518105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.518867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.520627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.531226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1102/2200] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:44.535053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.545201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.545341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27bfb-2111-43e1-9399-f6570eea3058 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.546672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.550477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.551202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.551786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.551786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.552467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.554167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601d140-e847-4aa0-863d-2e79576a01ec admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.557683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1099/2201] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:44.566753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1103/2202] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:44.570176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.583435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4e1b-dddc-4772-9a85-7372ec3052c7 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.589287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.589989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.590273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.590547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] PATH_INFO: `/v3/projects/6e45f0bd352f45eeb8d661bf37b21f3a/users/de19c6e2139b48cbb5c3b136d6f2dcf9/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.605926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e45f0bd352f45eeb8d661bf37b21f3a, user_id=de19c6e2139b48cbb5c3b136d6f2dcf9, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.608646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.622245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1100/2203] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:44 2022] PUT /identity/v3/projects/6e45f0bd352f45eeb8d661bf37b21f3a/users/de19c6e2139b48cbb5c3b136d6f2dcf9/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:44.632955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.633235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.634208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.673214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] MFA Rules not processed for user `de19c6e2139b48cbb5c3b136d6f2dcf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:44.675807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:44.709646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:44.746000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1104/2204] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:44.750532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.818136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1e06-7669-419a-b8d4-cce832c254f8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.823618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.824240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.824521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.824791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.825610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.827911 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.859525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1101/2205] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:44.862190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.873396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879a435-5ed3-4342-b347-ead661d79c64 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.938766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.939395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.939972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.939972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.940596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.942898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:44.965537 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1105/2206] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:44 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:44.969955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:44.981561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24a53-dd60-444a-994d-71b4049aee85 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:44.986636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:44.987432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:44.987737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:44.988013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:44.989060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:44.990541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.002083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1102/2207] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:45.006750 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.020522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed423f-97b6-4c29-ac51-afb094bef273 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.029386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.030593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.031280 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.031879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] PATH_INFO: `/v3/projects/e48d25de337e432f8438f82ea514b2c4/users/da918622cc6d4f478ed10069c3a60f6d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.051047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48d25de337e432f8438f82ea514b2c4, user_id=da918622cc6d4f478ed10069c3a60f6d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.053909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.068472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1106/2208] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:45 2022] PUT /identity/v3/projects/e48d25de337e432f8438f82ea514b2c4/users/da918622cc6d4f478ed10069c3a60f6d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:45.072425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.089094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36dc7d-e637-43ad-8090-243a87005087 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.155341 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.165577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.166243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.166526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.166803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.167493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.169203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.170667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:45.183310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1103/2209] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:45.193372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.204489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9410-6615-43a0-b221-a0a67301defe admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.209827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.210497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.210774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.213621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] PATH_INFO: `/v3/projects/e48d25de337e432f8438f82ea514b2c4/users/da918622cc6d4f478ed10069c3a60f6d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.215802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48d25de337e432f8438f82ea514b2c4, user_id=da918622cc6d4f478ed10069c3a60f6d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.218469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ab94-ff3d-4326-ab50-f98b697e2343 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.230508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1104/2210] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:45 2022] PUT /identity/v3/projects/e48d25de337e432f8438f82ea514b2c4/users/da918622cc6d4f478ed10069c3a60f6d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:45.238334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c798a-a765-4031-93c8-ff2e2505df90 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.241646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.242111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.242222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.273804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] MFA Rules not processed for user `da918622cc6d4f478ed10069c3a60f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:45.276563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:45.296114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.296804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.297487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.297487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.299208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:45.312343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:45.359406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1105/2211] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:45.376303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.377978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.392522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1107/2212] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:45.459049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.471490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee55e-2e4d-420c-bcf0-f353373d9606 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.475437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.476421 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.476873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.477355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.490778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.492284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.516776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1106/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:45.895744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.907668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82bff-65a4-4123-999e-16d3fbff9e9d service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.913443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da918622cc6d4f478ed10069c3a60f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48d25de337e432f8438f82ea514b2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.914468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.915505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.915944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.916928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:45.917298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.919201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.933028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1108/2214] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:45.937792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:45.947220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ed389-4e61-4a5e-90c8-cc5919027675 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:45.951935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da918622cc6d4f478ed10069c3a60f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48d25de337e432f8438f82ea514b2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:45.952577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:45.952877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:45.953175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:45.953890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:45.955903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:45.985389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1107/2215] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:45 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:45.989701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:46.001272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55d595-7d7e-40dd-8e3c-1c92fb2ea524 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:46.058578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da918622cc6d4f478ed10069c3a60f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48d25de337e432f8438f82ea514b2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:46.059221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:46.059503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:46.059782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:46.060470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:46.060776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:46.062401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:46.074601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1109/2216] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:46.112230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:46.125318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08985-1cee-4eb5-b983-bb1e7af7c0b0 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:46.130203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da918622cc6d4f478ed10069c3a60f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48d25de337e432f8438f82ea514b2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:46.130849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:46.131136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:46.131411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] PATH_INFO: `/v3/projects/21af564ab059496389d226f7c7feba06` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:46.132573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21af564ab059496389d226f7c7feba06)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:46.134852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:46.185795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21af564ab059496389d226f7c7feba06', 'request_id': 'req-95fcc7d3-bce6-467b-8470-90c19caec6ec'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.193137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21af564ab059496389d226f7c7feba06', 'request_id': 'req-95fcc7d3-bce6-467b-8470-90c19caec6ec'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.199290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21af564ab059496389d226f7c7feba06', 'request_id': 'req-95fcc7d3-bce6-467b-8470-90c19caec6ec'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.228579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] The token cache is being invalidate because project 21af564ab059496389d226f7c7feba06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:46.228945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.229780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95fcc7d3-bce6-467b-8470-90c19caec6ec tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.232025 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1108/2217] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:46 2022] DELETE /identity/v3/projects/21af564ab059496389d226f7c7feba06 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:46.433239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:46.435353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:46.502020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7a40-5f12-4b3a-a405-b1da27974e86 tempest-VolumeQuotaClassesTest-669784593 tempest-VolumeQuotaClassesTest-669784593-project-admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:46.532202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:46.559270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:46.559912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:46.560192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:46.560466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] PATH_INFO: `/v3/users/de19c6e2139b48cbb5c3b136d6f2dcf9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:46.561653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de19c6e2139b48cbb5c3b136d6f2dcf9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:46.563593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:46.609108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de19c6e2139b48cbb5c3b136d6f2dcf9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.609763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de19c6e2139b48cbb5c3b136d6f2dcf9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.617030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de19c6e2139b48cbb5c3b136d6f2dcf9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.617694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de19c6e2139b48cbb5c3b136d6f2dcf9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.630441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de19c6e2139b48cbb5c3b136d6f2dcf9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:46.647606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1110/2218] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:46 2022] DELETE /identity/v3/users/de19c6e2139b48cbb5c3b136d6f2dcf9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:46.653018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:46.653530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:46.653709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:46.676074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:46.676074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:46.687130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:46.750164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1109/2219] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:46.763178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:46.764736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:46.859998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248226f4-9e33-4c64-bfc5-7851662d2b5a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:46.867277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:46.868807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:46.869328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:46.869785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:46.889625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:46.889625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:46.901450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1111/2220] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:47.200852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:47.202317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:47.215255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f6f42-51a6-4a6f-b135-43fc8f9509ef None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:47.220664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:47.221432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:47.221825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:47.222176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] PATH_INFO: `/v3/projects/6e45f0bd352f45eeb8d661bf37b21f3a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:47.224411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e45f0bd352f45eeb8d661bf37b21f3a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:47.227747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:47.286176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e45f0bd352f45eeb8d661bf37b21f3a', 'request_id': 'req-d00d6e19-c7d0-4819-8719-de2411d01f68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.293262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e45f0bd352f45eeb8d661bf37b21f3a', 'request_id': 'req-d00d6e19-c7d0-4819-8719-de2411d01f68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.299381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e45f0bd352f45eeb8d661bf37b21f3a', 'request_id': 'req-d00d6e19-c7d0-4819-8719-de2411d01f68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.313967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] The token cache is being invalidate because project 6e45f0bd352f45eeb8d661bf37b21f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:47.314258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.314890 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.316438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1110/2221] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:47 2022] DELETE /identity/v3/projects/6e45f0bd352f45eeb8d661bf37b21f3a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:47.320570 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:47.332158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084461b-7b6c-4f1d-9cc2-529a3908eed6 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:47.386369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:47.394763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:47.395572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:47.396344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:47.396662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] PATH_INFO: `/v3/users/da918622cc6d4f478ed10069c3a60f6d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:47.398081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da918622cc6d4f478ed10069c3a60f6d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:47.400043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:47.446234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da918622cc6d4f478ed10069c3a60f6d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.446944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da918622cc6d4f478ed10069c3a60f6d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.455356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da918622cc6d4f478ed10069c3a60f6d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.455938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da918622cc6d4f478ed10069c3a60f6d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.468226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1c5a9be2-91f7-440c-8cba-1fdb36735d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da918622cc6d4f478ed10069c3a60f6d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.480716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1112/2222] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:47 2022] DELETE /identity/v3/users/da918622cc6d4f478ed10069c3a60f6d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:47.754833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:47.756686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:47.772302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e19-c7d0-4819-8719-de2411d01f68 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:47.838997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:47.839566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:47.839880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:47.840233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] PATH_INFO: `/v3/projects/e48d25de337e432f8438f82ea514b2c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:47.841637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48d25de337e432f8438f82ea514b2c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:47.843838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:47.889809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:47.897940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48d25de337e432f8438f82ea514b2c4', 'request_id': 'req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.910218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48d25de337e432f8438f82ea514b2c4', 'request_id': 'req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.919576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48d25de337e432f8438f82ea514b2c4', 'request_id': 'req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.937827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] The token cache is being invalidate because project e48d25de337e432f8438f82ea514b2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:47.938109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.938825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7526f2df-216b-4ceb-86f7-9bcd80f7ac40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:47.940647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1111/2223] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:47 2022] DELETE /identity/v3/projects/e48d25de337e432f8438f82ea514b2c4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:47.946586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:47.946900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:47.947180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:47.970904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:47.972148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:48.084643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1113/2224] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:48.093009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.093297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.093607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.114149 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:48.115359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:48.124814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1112/2225] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:48.133850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.141060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ce26-da2f-447c-8e26-2ba40c51b801 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.145974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.146599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.146882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.147157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.147859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:48.148165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.150150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.162805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1114/2226] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:48.168191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.182529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47fcea-c7d0-403a-b085-f54d09db316b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.187759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.188389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.188886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.189011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.189719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.192358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.225293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1113/2227] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:48.226595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.237249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725fd1-9c02-45aa-be64-541b2ec19362 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.308343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.308853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.309232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.309641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.310573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.312995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.324233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:48.345571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1115/2228] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:48.346451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.358976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895626-f691-494a-998d-103cebfa4f80 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.369976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.370641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.371216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.371503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.372415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.374387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.387566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1114/2229] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:48.391723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.403006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6df85-c766-4bbd-9390-c3f7a23950c0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.408481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.409251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.409659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.410013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.410769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.412377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7db76c-d3be-4975-ad61-a81b69dfcede admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.423819 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1116/2230] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:48.428227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.439581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0435b-2561-4f6f-b234-05c5dd355e84 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.444424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.445098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.445380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.445692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] PATH_INFO: `/v3/projects/0442528d2f6d4f02a9b03f0a9397a943/users/8ffa5065ce70471ba8204636eb218421/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.466058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0442528d2f6d4f02a9b03f0a9397a943, user_id=8ffa5065ce70471ba8204636eb218421, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.469602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.486403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1115/2231] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:48 2022] PUT /identity/v3/projects/0442528d2f6d4f02a9b03f0a9397a943/users/8ffa5065ce70471ba8204636eb218421/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:48.498476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.498948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.499035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.526607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] MFA Rules not processed for user `8ffa5065ce70471ba8204636eb218421`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:48.527793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:48.592603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1117/2232] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:48.597037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.659278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf151de-bfea-42f1-bcd7-ea120b783559 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.664019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.664736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.665121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.665400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.666096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.668005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.694891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1116/2233] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:48.699303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.712343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59068-ba71-4005-bf08-94c6d465ac96 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.769552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.770172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.770452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.770725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.771397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.773319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.794114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1118/2234] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:48 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:48.797940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.811151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d04eb2-0b85-4089-bde5-6f545d30679d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.816034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.816658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.816967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.817223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.817999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.819608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.831741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1117/2235] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:48.836017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.846703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf2c-1faa-4d40-b6c2-e797c92e2506 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.851231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.851879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.852791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.853063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] PATH_INFO: `/v3/projects/be2f4c2b4abf415d86f426db96815869/users/0cff46235bb24311af7a50a06d7384cb/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.868011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f4c2b4abf415d86f426db96815869, user_id=0cff46235bb24311af7a50a06d7384cb, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.871101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.885979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1119/2236] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:48 2022] PUT /identity/v3/projects/be2f4c2b4abf415d86f426db96815869/users/0cff46235bb24311af7a50a06d7384cb/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:48.890381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.901041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5704b0b-94bd-4b66-beb4-9c3b1b1d8af1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.942124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:48.967318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:48.967974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:48.968259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:48.968536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:48.969233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:48.970935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f228-01e0-4833-a28f-998b7a953307 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:48.980741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1118/2237] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:48.985154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:48.995319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56151-5c59-42c5-833b-f92d41601ea3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:48.999931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.000586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.000865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.001140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] PATH_INFO: `/v3/projects/be2f4c2b4abf415d86f426db96815869/users/0cff46235bb24311af7a50a06d7384cb/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.003105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f4c2b4abf415d86f426db96815869, user_id=0cff46235bb24311af7a50a06d7384cb, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.005777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.017185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1120/2238] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:48 2022] PUT /identity/v3/projects/be2f4c2b4abf415d86f426db96815869/users/0cff46235bb24311af7a50a06d7384cb/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:49.028637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.028924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.029197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.057739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] MFA Rules not processed for user `0cff46235bb24311af7a50a06d7384cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:49.058958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.103752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.106002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.134649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:49.150296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1119/2239] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:49.162626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.164155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.204004 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47620c3-a274-4ec4-ada4-190896f14bda admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.209032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ee009-6992-42a0-a888-042378810182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.209701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee009-6992-42a0-a888-042378810182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.209978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee009-6992-42a0-a888-042378810182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.210258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee009-6992-42a0-a888-042378810182 admin admin] PATH_INFO: `/v3/users/95bf79bf8ca34034bd15ea9b9a82801b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.212135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ee009-6992-42a0-a888-042378810182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bf79bf8ca34034bd15ea9b9a82801b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.214277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ee009-6992-42a0-a888-042378810182 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.235695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b055d-c050-4ded-822b-c6e99a73047b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.239919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.240548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.240861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.241106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.253868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.255700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688c6ec-3b0b-417e-8c4b-c3e3674455ec service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.266380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1120/2240] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:49.267731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bf79bf8ca34034bd15ea9b9a82801b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.268441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bf79bf8ca34034bd15ea9b9a82801b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.277513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bf79bf8ca34034bd15ea9b9a82801b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.278182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bf79bf8ca34034bd15ea9b9a82801b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.293527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bf79bf8ca34034bd15ea9b9a82801b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.316730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1121/2241] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:49 2022] DELETE /identity/v3/users/95bf79bf8ca34034bd15ea9b9a82801b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:49.321723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.322093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.322391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.347079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:49.347079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.414565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1121/2242] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:49.426484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.429982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.502948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ee009-6992-42a0-a888-042378810182 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.508290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.509646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.510793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.510793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.522545 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.524262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6056-0812-446e-96a6-23b4c18bc836 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.535356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1122/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:49.569662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.571767 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.582632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:49.591736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b753133-f0b6-43b4-aca4-3eda63fb8f4e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.598030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.598865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.599032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.599502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] PATH_INFO: `/v3/users/2ff7d1659e664ebfb6977581bf62fa6f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.600829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff7d1659e664ebfb6977581bf62fa6f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.603974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.681830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff7d1659e664ebfb6977581bf62fa6f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.682519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff7d1659e664ebfb6977581bf62fa6f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.690444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff7d1659e664ebfb6977581bf62fa6f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.700667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff7d1659e664ebfb6977581bf62fa6f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.701338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff7d1659e664ebfb6977581bf62fa6f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.726282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1122/2244] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:49 2022] DELETE /identity/v3/users/2ff7d1659e664ebfb6977581bf62fa6f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:49.731445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.731728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.731996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.756369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:49.757779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.773491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.775309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.812264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:49.840654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1123/2245] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:49.850434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.852070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.867838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57071-9202-4de4-a878-29b912c1bc36 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.874929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.875664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.876018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.876363 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] PATH_INFO: `/v3/users/8ffa5065ce70471ba8204636eb218421` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.877673 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffa5065ce70471ba8204636eb218421)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.879727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.929363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dfa37-1633-4abd-9caa-89f14cd76022 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.934781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.935405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.935684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.935961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.943381 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffa5065ce70471ba8204636eb218421'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.946405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.947918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.948859 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffa5065ce70471ba8204636eb218421'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.956684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffa5065ce70471ba8204636eb218421'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.958295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1124/2246] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:49.959114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:49.960389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:49.970529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffa5065ce70471ba8204636eb218421'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.971272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32597e5c-907e-4ef9-8a15-58bc9b62f643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffa5065ce70471ba8204636eb218421'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:49.975601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51753f8b-9d93-4e48-b17c-75ce9e7e1f97 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:49.981698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:49.982546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:49.982899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:49.983245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] PATH_INFO: `/v3/projects/da72b0db8a954aa5bf6fd46607f34711` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:49.984656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:49.984775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da72b0db8a954aa5bf6fd46607f34711)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:49.986890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:49.996610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1123/2247] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:49 2022] DELETE /identity/v3/users/8ffa5065ce70471ba8204636eb218421 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:50.000654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f86a-a437-42a8-b95d-da801400653c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.000944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f86a-a437-42a8-b95d-da801400653c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.001221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f86a-a437-42a8-b95d-da801400653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.028055 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7489f86a-a437-42a8-b95d-da801400653c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:50.029918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7489f86a-a437-42a8-b95d-da801400653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.054129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da72b0db8a954aa5bf6fd46607f34711', 'request_id': 'req-310c834b-5fb3-4045-a508-e094601f2823'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.063400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da72b0db8a954aa5bf6fd46607f34711', 'request_id': 'req-310c834b-5fb3-4045-a508-e094601f2823'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.076536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da72b0db8a954aa5bf6fd46607f34711', 'request_id': 'req-310c834b-5fb3-4045-a508-e094601f2823'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.090995 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] The token cache is being invalidate because project da72b0db8a954aa5bf6fd46607f34711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:50.091401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.092137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.094102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1125/2248] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:49 2022] DELETE /identity/v3/projects/da72b0db8a954aa5bf6fd46607f34711 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:50.097762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.099132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.103924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1124/2249] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:50.115927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489f86a-a437-42a8-b95d-da801400653c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.124768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7489f86a-a437-42a8-b95d-da801400653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.183534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c834b-5fb3-4045-a508-e094601f2823 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.192697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.193367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.193682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.193959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] PATH_INFO: `/v3/users/5c8ac182d3aa478e8d1ef353df1ba404` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.199041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8ac182d3aa478e8d1ef353df1ba404)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.201179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.205980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489f86a-a437-42a8-b95d-da801400653c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.215449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:50.275727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.277666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.278133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.278275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8ac182d3aa478e8d1ef353df1ba404'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.278634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.278914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8ac182d3aa478e8d1ef353df1ba404'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.293124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.294737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8ac182d3aa478e8d1ef353df1ba404'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.295496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8ac182d3aa478e8d1ef353df1ba404'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.298246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.311073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1125/2250] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:50.311449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8ac182d3aa478e8d1ef353df1ba404'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.320063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.325903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.332497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1126/2251] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:50 2022] DELETE /identity/v3/users/5c8ac182d3aa478e8d1ef353df1ba404 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:50.340479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aeddb-913b-460e-bec4-060b720431bd service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.394941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:50.402374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.403164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.403597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.403937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] PATH_INFO: `/v3/projects/4033eb3313cb4cc29c231508f0ece9d7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.405577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4033eb3313cb4cc29c231508f0ece9d7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.407781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.466353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4033eb3313cb4cc29c231508f0ece9d7', 'request_id': 'req-7266e345-522b-43f0-8f2b-8693e78ec993'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.478696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4033eb3313cb4cc29c231508f0ece9d7', 'request_id': 'req-7266e345-522b-43f0-8f2b-8693e78ec993'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.486007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4033eb3313cb4cc29c231508f0ece9d7', 'request_id': 'req-7266e345-522b-43f0-8f2b-8693e78ec993'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.503787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] The token cache is being invalidate because project 4033eb3313cb4cc29c231508f0ece9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:50.503969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.504716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.506780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1126/2252] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:50 2022] DELETE /identity/v3/projects/4033eb3313cb4cc29c231508f0ece9d7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:50.510764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.512686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.540491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeaa05-073b-463a-a334-6d9417d03966 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.609804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.610436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.610721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.610992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] PATH_INFO: `/v3/users/ed2cf1570934437484de89e97c1d1efe` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.612365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2cf1570934437484de89e97c1d1efe)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.614395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.675428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2cf1570934437484de89e97c1d1efe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.676582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2cf1570934437484de89e97c1d1efe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.686093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2cf1570934437484de89e97c1d1efe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.686953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2cf1570934437484de89e97c1d1efe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.703129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2cf1570934437484de89e97c1d1efe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.720193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1127/2253] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:50 2022] DELETE /identity/v3/users/ed2cf1570934437484de89e97c1d1efe => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:50.757976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.760184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.778373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e345-522b-43f0-8f2b-8693e78ec993 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.852110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.852987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.853266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.853649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] PATH_INFO: `/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.854850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b480d6c2e9654a13912bc9a3dd4f5c2c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.857003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.869134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:50.871075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.885731 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862cbe-41e2-4ed3-86ba-263d214949bf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:50.892577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:50.893406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.893865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.894414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] PATH_INFO: `/v3/projects/0442528d2f6d4f02a9b03f0a9397a943` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.895718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0442528d2f6d4f02a9b03f0a9397a943)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:50.897829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:50.904180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:50.925540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b480d6c2e9654a13912bc9a3dd4f5c2c', 'request_id': 'req-2c936c23-c615-403a-8a53-f9f4b5626033'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.935750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b480d6c2e9654a13912bc9a3dd4f5c2c', 'request_id': 'req-2c936c23-c615-403a-8a53-f9f4b5626033'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.944253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b480d6c2e9654a13912bc9a3dd4f5c2c', 'request_id': 'req-2c936c23-c615-403a-8a53-f9f4b5626033'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.960495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] The token cache is being invalidate because project b480d6c2e9654a13912bc9a3dd4f5c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:50.960495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.961191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c936c23-c615-403a-8a53-f9f4b5626033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.962832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1127/2254] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:50 2022] DELETE /identity/v3/projects/b480d6c2e9654a13912bc9a3dd4f5c2c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:50.968621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:50.969067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:50.969215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:50.987356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0442528d2f6d4f02a9b03f0a9397a943', 'request_id': 'req-e0f01833-686a-46ce-8e3f-012ba1bf5c82'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:50.993604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:50.996012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:50.996189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0442528d2f6d4f02a9b03f0a9397a943', 'request_id': 'req-e0f01833-686a-46ce-8e3f-012ba1bf5c82'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.005285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0442528d2f6d4f02a9b03f0a9397a943', 'request_id': 'req-e0f01833-686a-46ce-8e3f-012ba1bf5c82'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.009209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:51.021629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] The token cache is being invalidate because project 0442528d2f6d4f02a9b03f0a9397a943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:51.021929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.022941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.025244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1128/2255] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:50 2022] DELETE /identity/v3/projects/0442528d2f6d4f02a9b03f0a9397a943 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:51.029219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.031024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.084959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1128/2256] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:51.093605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.095122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.109298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e561-6b15-40c1-a9ba-948b5fa687c8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.123179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.123851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.124134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.124404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] PATH_INFO: `/v3/projects/0ad73458aa1943908fb0bbe14b065cd9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.125722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad73458aa1943908fb0bbe14b065cd9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.127667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.128531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01833-686a-46ce-8e3f-012ba1bf5c82 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.134531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.135206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.135487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.135762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] PATH_INFO: `/v3/users/0cff46235bb24311af7a50a06d7384cb` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.137286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cff46235bb24311af7a50a06d7384cb)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.139399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.176680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad73458aa1943908fb0bbe14b065cd9', 'request_id': 'req-15d86e8c-d890-4e48-be78-82dd5726a59a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.183187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad73458aa1943908fb0bbe14b065cd9', 'request_id': 'req-15d86e8c-d890-4e48-be78-82dd5726a59a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.190058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cff46235bb24311af7a50a06d7384cb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.192287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cff46235bb24311af7a50a06d7384cb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.193826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad73458aa1943908fb0bbe14b065cd9', 'request_id': 'req-15d86e8c-d890-4e48-be78-82dd5726a59a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.200096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cff46235bb24311af7a50a06d7384cb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.200768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cff46235bb24311af7a50a06d7384cb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.207220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] The token cache is being invalidate because project 0ad73458aa1943908fb0bbe14b065cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:51.207516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.208181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-15d86e8c-d890-4e48-be78-82dd5726a59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.209939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1129/2257] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:51 2022] DELETE /identity/v3/projects/0ad73458aa1943908fb0bbe14b065cd9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:51.211081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.211932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.212213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.216649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cff46235bb24311af7a50a06d7384cb'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.228909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1129/2258] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:51 2022] DELETE /identity/v3/users/0cff46235bb24311af7a50a06d7384cb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:51.231938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.231938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.232112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:51.234654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.246738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:51.316718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1130/2259] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:51.317371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85a0e-d1e4-4123-a258-c81fe80fd991 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.321465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.324401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.325123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.325403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.325703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] PATH_INFO: `/v3/users/c8ae61acc74c4e7ab6bf719e7c0811d1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.326905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ae61acc74c4e7ab6bf719e7c0811d1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.329030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.331556 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e880fc-2892-46fd-87a2-f7798f8b5fbb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.337257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.337940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.338224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.338504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.339347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:51.339661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.341929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.358549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1131/2260] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:51.363497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.376270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43777d0-e710-44fe-b06e-70b292a45015 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.381997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.382663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.382952 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.383312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.383992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.385966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.395803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ae61acc74c4e7ab6bf719e7c0811d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.396492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ae61acc74c4e7ab6bf719e7c0811d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.406773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ae61acc74c4e7ab6bf719e7c0811d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.408954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ae61acc74c4e7ab6bf719e7c0811d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.422539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1132/2261] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:51 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:51.424988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ae61acc74c4e7ab6bf719e7c0811d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.427012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.429367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.440655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:51.442507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1130/2262] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:51 2022] DELETE /identity/v3/users/c8ae61acc74c4e7ab6bf719e7c0811d1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:51.550492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ad9d8-7ef6-4471-a912-20336a625d67 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.591087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.593196 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.671623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.671623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.671884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.671985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.672607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.675488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.707359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1133/2263] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:51 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:51.711596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.734672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31479657-318d-4f94-a762-aa938d30b5c7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.739756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.740555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.740937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.741347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.742171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.744967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.751378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cef2-9527-4066-a07c-15987a161e48 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.756346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.757211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.757546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.757814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] PATH_INFO: `/v3/projects/be2f4c2b4abf415d86f426db96815869` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.759157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1134/2264] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:51.759994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2f4c2b4abf415d86f426db96815869)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.762286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.763512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.785817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c02f60-8a7e-4f90-997c-203780c1eadb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.794977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.795906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.796198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.796615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.797325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.799133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:51.809136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:51.826435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1135/2265] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:51.832813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:51.838397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2f4c2b4abf415d86f426db96815869', 'request_id': 'req-501dc835-9858-4ce8-a7ae-b1c1344e02d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.845052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2f4c2b4abf415d86f426db96815869', 'request_id': 'req-501dc835-9858-4ce8-a7ae-b1c1344e02d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.855252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2f4c2b4abf415d86f426db96815869', 'request_id': 'req-501dc835-9858-4ce8-a7ae-b1c1344e02d4'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.871556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] The token cache is being invalidate because project be2f4c2b4abf415d86f426db96815869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:51.872035 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.872680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03bb97-22a6-40a1-bcd3-2f3df7598b30 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:51.872969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-501dc835-9858-4ce8-a7ae-b1c1344e02d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:51.874703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1131/2266] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:51 2022] DELETE /identity/v3/projects/be2f4c2b4abf415d86f426db96815869 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:51.880501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.880736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.881025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.932330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:51.933590 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:51.971278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:51.972097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:51.972392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:51.972676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] PATH_INFO: `/v3/projects/edcdf0985e104915898e5336553eacdd/users/cb95573be49d4661a116ec358ff7a31b/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:51.993827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcdf0985e104915898e5336553eacdd, user_id=cb95573be49d4661a116ec358ff7a31b, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:51.996549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b901e9-d871-4c2e-8284-aed67d9d3b4f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.009779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1132/2267] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.009779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.009779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.016945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1136/2268] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:51 2022] PUT /identity/v3/projects/edcdf0985e104915898e5336553eacdd/users/cb95573be49d4661a116ec358ff7a31b/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:52.018610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050d2e2-b732-4cff-b427-e3e5010ccd39 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.018757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050d2e2-b732-4cff-b427-e3e5010ccd39 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.019037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050d2e2-b732-4cff-b427-e3e5010ccd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.027716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:52.035511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4651f-3bdd-49be-9d1f-939938a78aed None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.043470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b050d2e2-b732-4cff-b427-e3e5010ccd39 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.045504 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b050d2e2-b732-4cff-b427-e3e5010ccd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.116427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.117076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.117366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.117709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] PATH_INFO: `/v3/projects/8b764be21ad4424d8e429a1105f953a9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.119049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b764be21ad4424d8e429a1105f953a9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.121259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.121380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1137/2269] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.122580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4e626-0aee-4bb7-b74b-dd36f25f8cee None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.122941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4e626-0aee-4bb7-b74b-dd36f25f8cee None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.123223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4e626-0aee-4bb7-b74b-dd36f25f8cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.155704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-52c4e626-0aee-4bb7-b74b-dd36f25f8cee None None] MFA Rules not processed for user `cb95573be49d4661a116ec358ff7a31b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.156796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-52c4e626-0aee-4bb7-b74b-dd36f25f8cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.191976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b764be21ad4424d8e429a1105f953a9', 'request_id': 'req-08fccea9-6e29-4859-97cc-3d9f35171a8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:52.201707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b764be21ad4424d8e429a1105f953a9', 'request_id': 'req-08fccea9-6e29-4859-97cc-3d9f35171a8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:52.205500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:52.216529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b764be21ad4424d8e429a1105f953a9', 'request_id': 'req-08fccea9-6e29-4859-97cc-3d9f35171a8d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:52.229643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] The token cache is being invalidate because project 8b764be21ad4424d8e429a1105f953a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:52.229996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:52.230770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:52.232533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1133/2270] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:52 2022] DELETE /identity/v3/projects/8b764be21ad4424d8e429a1105f953a9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:52.233109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.234455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.262290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1138/2271] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.263895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.264191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.264470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.292814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.294223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.328276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccea9-6e29-4859-97cc-3d9f35171a8d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.333233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.333882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.334157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.334551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.335250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:52.335552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.337870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.350465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1134/2272] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:52.351321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.353743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.380137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1139/2273] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.381074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.393103 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2209c-cfe9-47cd-a888-7657150517bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.398126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.399278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.399555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.399827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.400489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.402448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e138793-0e70-46f9-ba6f-e2d18a777ce1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.412583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483992b-aadb-4471-a265-825a67d0bef3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.416972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.417600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.417876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.418147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.419923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.430954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1140/2274] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:52.432223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544525-ea52-469f-9573-27d94403707b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.432514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544525-ea52-469f-9573-27d94403707b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.432788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544525-ea52-469f-9573-27d94403707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.452209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-59544525-ea52-469f-9573-27d94403707b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.453409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-59544525-ea52-469f-9573-27d94403707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.459044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:52.483490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.484923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.494052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1135/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:52.495870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.507347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39716bb5-8484-4deb-9590-ef7766888138 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.519553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1141/2276] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.524274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59544525-ea52-469f-9573-27d94403707b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.534260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59544525-ea52-469f-9573-27d94403707b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.541866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.542497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.542779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.543254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.543751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:52.544118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.545964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.553224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:52.558362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1142/2277] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:52.564083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.575042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb4c7-95fd-4c9f-9f09-d62facf936bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.580425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.581027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.581173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.581314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.581629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.581738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.581962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.582239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.582345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.582901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.584366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.584840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.612912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1136/2278] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:52.616761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.621179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1143/2279] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:52.624907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.640033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2089e74-d6a9-4cc8-9165-d6256ef0c91d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.698491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9986d2-53b0-4f95-8ab4-f3d639519ade admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.703725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.704345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.704676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.704956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.705646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.707599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.712353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.713017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.713337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.713646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.714975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.718218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.729298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1144/2280] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:47:52.734069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1137/2281] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:52.734400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.737777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.747109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20110-4828-4cf1-a39f-7cb4029cb6f3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.748916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbc8c-8670-4252-a759-c1c52fec23b3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.752155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.752812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.753101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.753378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.754121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.754243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.754903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.755250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.755592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.755775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.756342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.758083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.767255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1145/2282] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:52.771060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.772368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1138/2283] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:52.782818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.782948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5fc6-af38-45c9-81eb-06e6e9bb59ab admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.788374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.789085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.789920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.790259 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.790966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.792612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.805786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1146/2284] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:52.809441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.817458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35d667-6bf3-4e25-b950-75911ada3ab0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.819301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990718-c028-442d-ab42-5b335b3e0127 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:52.824312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.824746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:52.824981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.825264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.825576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] PATH_INFO: `/v3/projects/08c9f4e58cfe412db2ec45f1444ce316/users/c62a7d59d7f14c37860d53079792b970/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.825691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.825862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.826181 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] PATH_INFO: `/v3/projects/1658d63aa1b54aa5a36754e83179e317/users/0c22bac56ed1472a9b2e7b6943736333/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.844627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1658d63aa1b54aa5a36754e83179e317, user_id=0c22bac56ed1472a9b2e7b6943736333, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.847666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2643a-35ca-42ec-a7df-de14862bc300 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.856032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c9f4e58cfe412db2ec45f1444ce316, user_id=c62a7d59d7f14c37860d53079792b970, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:52.860422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65974d37-0598-4ccf-a489-4fec254d986c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:52.864152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1139/2285] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:52 2022] PUT /identity/v3/projects/1658d63aa1b54aa5a36754e83179e317/users/0c22bac56ed1472a9b2e7b6943736333/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:52.870210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.870505 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.871002 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.886157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1147/2286] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:52 2022] PUT /identity/v3/projects/08c9f4e58cfe412db2ec45f1444ce316/users/c62a7d59d7f14c37860d53079792b970/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:52.894719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.897000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.958120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:52.958413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:52.958864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:52.980253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1140/2287] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:52.989901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] MFA Rules not processed for user `c62a7d59d7f14c37860d53079792b970`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:52.990838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:52.991171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:52.992224 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:53.000796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:53.040359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:53.059244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450964-f434-4df9-a0d0-2026424b71fb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:53.062945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:53.063561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:53.063842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:53.064117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:53.064526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1148/2288] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:47:53.074577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:53.076316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b44915-2e23-4c74-a700-ea97aba98e8b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:53.077712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:53.086489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1141/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:53.143608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71bf9-0313-40e7-b89a-35c74354e858 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:53.147341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:53.147978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:53.148265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:53.148544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:53.158177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:53.159618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:53.170221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1149/2290] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:53.805473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04001d-8683-40a0-9665-2e8e3166ac0c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:53.806028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04001d-8683-40a0-9665-2e8e3166ac0c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:53.806028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04001d-8683-40a0-9665-2e8e3166ac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:53.833942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8a04001d-8683-40a0-9665-2e8e3166ac0c None None] MFA Rules not processed for user `0c22bac56ed1472a9b2e7b6943736333`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:53.835159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8a04001d-8683-40a0-9665-2e8e3166ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:53.918672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1142/2291] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:53.933352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:53.942957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d911f-9e7c-4e98-9329-6ca33a8225c8 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:53.948514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:53.949133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:53.949447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:53.949721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:53.960179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:53.966995 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:53.977997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1150/2292] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:47:55.390506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140006d-e43e-4be0-9678-97be476d254c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:55.391019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140006d-e43e-4be0-9678-97be476d254c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:55.391111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140006d-e43e-4be0-9678-97be476d254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:55.411185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f140006d-e43e-4be0-9678-97be476d254c None None] MFA Rules not processed for user `0c22bac56ed1472a9b2e7b6943736333`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:55.412427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f140006d-e43e-4be0-9678-97be476d254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:55.420244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1143/2293] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:55.634080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:55.635547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:55.650030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3a06c-127a-4ce1-b07a-ac1341115dda service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:55.654749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:55.655399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:55.655683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:55.656826 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] PATH_INFO: `/v3/users/cb95573be49d4661a116ec358ff7a31b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:55.658161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb95573be49d4661a116ec358ff7a31b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:55.660197 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:55.708291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb95573be49d4661a116ec358ff7a31b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:55.708581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb95573be49d4661a116ec358ff7a31b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:55.715624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb95573be49d4661a116ec358ff7a31b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:55.723188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb95573be49d4661a116ec358ff7a31b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:55.723807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb95573be49d4661a116ec358ff7a31b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:55.747038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1151/2294] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:55 2022] DELETE /identity/v3/users/cb95573be49d4661a116ec358ff7a31b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:55.749571 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:55.749923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:55.750262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:55.777996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:55.780552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:55.869733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1144/2295] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:55.878567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:55.879850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:55.896246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:55.952918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203ebbe-6803-4ac7-8ceb-14215b8e472c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:55.956736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:55.957487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:55.957839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:55.958158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:55.968475 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:55.969943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39057ca-83eb-4adc-8c11-393691966d3f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:55.983018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1152/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:56.275016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.277089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:56.312662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724ae5-4731-4dd5-99d4-3482840e25c7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.324201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.324861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.325141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.325442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] PATH_INFO: `/v3/projects/edcdf0985e104915898e5336553eacdd` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.326609 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcdf0985e104915898e5336553eacdd)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.328519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.382211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcdf0985e104915898e5336553eacdd', 'request_id': 'req-a1d97adc-7248-45b7-900f-e44667e2a382'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:56.385830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:56.391576 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcdf0985e104915898e5336553eacdd', 'request_id': 'req-a1d97adc-7248-45b7-900f-e44667e2a382'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:56.402288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcdf0985e104915898e5336553eacdd', 'request_id': 'req-a1d97adc-7248-45b7-900f-e44667e2a382'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:56.421201 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] The token cache is being invalidate because project edcdf0985e104915898e5336553eacdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:47:56.421737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:56.422675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-a1d97adc-7248-45b7-900f-e44667e2a382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:56.425029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1145/2297] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:56 2022] DELETE /identity/v3/projects/edcdf0985e104915898e5336553eacdd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:56.429822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.430299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.430681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.452085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:56.453390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:56.514592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1153/2298] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:56.522268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.522562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.522845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.544059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:56.545278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:56.554241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1146/2299] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:56.558688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.568589 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900d062-258c-455b-bd26-a3ebc570a2e0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.574413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.575041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.575325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.575605 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.576309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:47:56.576621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.578252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.591184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1154/2300] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:47:56.595688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.605041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543afb7-5329-4ad3-afac-47b899bb70dc None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.609597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.610206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.610484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.610755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.611423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.613326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.640347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1147/2301] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:56.644634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.655410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929aab-fad2-4913-a32b-962a106cd916 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.710541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.711712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.711997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.712310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.712980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.714924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.735227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1155/2302] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:47:56 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:47:56.739353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.750086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af56f9-4aa2-410b-968e-a5030fd263e6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.754709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.755319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.755602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.755876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.756567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.758947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.768964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1148/2303] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:47:56.772803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.782838 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aed47-fcca-4db9-a801-f4465b5763b5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.787331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.787932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.788208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.788477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.789167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.790845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0cc8a-6c76-44ad-8fbc-204d98640369 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.801110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1156/2304] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:47:56.805602 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.815501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed4be-e5d1-4b5e-a7ae-f41037bb33f8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:56.820142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:56.821614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.821900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.822178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] PATH_INFO: `/v3/projects/460961ebb939469c96621850ab00bd8e/users/eb1af73fd4ac487fac1568cb445a511d/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.836838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=460961ebb939469c96621850ab00bd8e, user_id=eb1af73fd4ac487fac1568cb445a511d, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:56.839548 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:56.853368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1149/2305] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:47:56 2022] PUT /identity/v3/projects/460961ebb939469c96621850ab00bd8e/users/eb1af73fd4ac487fac1568cb445a511d/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:47:56.864672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:56.864926 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:56.865201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:56.893498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] MFA Rules not processed for user `eb1af73fd4ac487fac1568cb445a511d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:56.894702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:56.902997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:56.978972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1157/2306] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:56.989531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:56.991190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:57.047901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1142-c04a-4aa0-92c6-a30e2634c40b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:57.051587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:57.052199 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:57.052475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:57.052743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:57.061686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:57.063106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e30a-f817-4ed2-a352-95431ebd94ab service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:57.072676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1150/2307] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:59.061797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:59.063771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:59.136824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970f80a-f5ee-41be-87f9-30dd17dfdc90 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:59.141687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:59.142344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:59.142626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:59.142903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] PATH_INFO: `/v3/users/e41fb8f7c3144060bc9d2c560ce07060` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:59.144108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41fb8f7c3144060bc9d2c560ce07060)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:59.146071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:59.209506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41fb8f7c3144060bc9d2c560ce07060'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:59.210171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41fb8f7c3144060bc9d2c560ce07060'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:59.217215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41fb8f7c3144060bc9d2c560ce07060'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:59.225094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41fb8f7c3144060bc9d2c560ce07060'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:59.225804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41fb8f7c3144060bc9d2c560ce07060'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:47:59.244606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1158/2308] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:47:59 2022] DELETE /identity/v3/users/e41fb8f7c3144060bc9d2c560ce07060 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:47:59.249116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cbaf-6028-4d2d-9a15-21798de31ad7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:59.249584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cbaf-6028-4d2d-9a15-21798de31ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:59.249699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0cbaf-6028-4d2d-9a15-21798de31ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:59.269721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f1c0cbaf-6028-4d2d-9a15-21798de31ad7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:59.270998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f1c0cbaf-6028-4d2d-9a15-21798de31ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:59.340558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1151/2309] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:59.347468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:59.349289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:59.387411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:59.417645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514a83-af96-4668-8857-6e7f30926fcc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:59.421352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:59.422006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:59.422311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:59.422592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:59.432336 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:59.433867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:47:59.444016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1159/2310] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:47:59.492139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883f42-7dee-4dcf-b5b2-ca352b2cb1ff None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:59.492419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883f42-7dee-4dcf-b5b2-ca352b2cb1ff None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:59.492671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883f42-7dee-4dcf-b5b2-ca352b2cb1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:59.520274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-48883f42-7dee-4dcf-b5b2-ca352b2cb1ff None None] MFA Rules not processed for user `eb1af73fd4ac487fac1568cb445a511d`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:47:59.521575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-48883f42-7dee-4dcf-b5b2-ca352b2cb1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:59.536208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:59.590494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1152/2311] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:47:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:47:59.943157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:47:59.945116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:47:59.962957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f3f4-db1c-49ae-b7c6-b699ef6bdc08 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:47:59.969899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:47:59.971280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:47:59.971280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:47:59.971280 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] PATH_INFO: `/v3/projects/8f219bb0856b450baf07b3251ad3d711` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:47:59.972273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f219bb0856b450baf07b3251ad3d711)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:47:59.978742 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.098392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f219bb0856b450baf07b3251ad3d711', 'request_id': 'req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:00.108932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f219bb0856b450baf07b3251ad3d711', 'request_id': 'req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:00.115836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f219bb0856b450baf07b3251ad3d711', 'request_id': 'req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:00.137432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] The token cache is being invalidate because project 8f219bb0856b450baf07b3251ad3d711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:00.138019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:00.138928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8aa9afb6-b294-4e2c-9c68-63ba3ee1165f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:00.142148 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1160/2312] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:47:59 2022] DELETE /identity/v3/projects/8f219bb0856b450baf07b3251ad3d711 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:00.147952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.148261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.149250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.212949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:00.214663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:00.330911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1153/2313] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:00.341123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.341693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.342160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.389759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:00.391207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:00.407205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1161/2314] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:00.412679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.434536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12527ec1-742a-4fc2-9f4a-1c445164a254 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.464765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.465432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.465726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.465999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.466754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:48:00.467067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.475812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.509088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1154/2315] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:48:00.510625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.524137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f151f-813f-4ada-9c45-e974af0bbdf6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.534793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.535696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.536136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.536552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.537575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.542675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.596990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1162/2316] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:48:00 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:48:00.601288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.620141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45581e22-d45e-4d49-8cec-c5d2bb20f4b3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.710603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.711835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.712292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.712901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.713512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.715610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.741829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1155/2317] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:48:00 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:48:00.746872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.760619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ab5b7-1820-43e6-b9f2-a910e4d7c079 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.766017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.766659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.766932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.767215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.767907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.770267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.787333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1163/2318] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:48:00.791940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.803567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1910889-1b20-48f3-a780-5f7afb68d52a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.809838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.810787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.811141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.811608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.812367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.814122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db372f2c-ceda-4dda-a719-df50e5281ba1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.827666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1156/2319] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:48:00.834578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:00.847493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058ea9-9a3b-41c2-9060-2f07333479c6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:00.854260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:00.855200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.855661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.856078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] PATH_INFO: `/v3/projects/5794f638657e45b4aa54ba28dbcda81a/users/9d36a5ab2a144438bebaa23ea06788de/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.875010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5794f638657e45b4aa54ba28dbcda81a, user_id=9d36a5ab2a144438bebaa23ea06788de, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:00.879377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:00.896473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1164/2320] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:48:00 2022] PUT /identity/v3/projects/5794f638657e45b4aa54ba28dbcda81a/users/9d36a5ab2a144438bebaa23ea06788de/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:00.909259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:00.909581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:00.909856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:00.942543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] MFA Rules not processed for user `9d36a5ab2a144438bebaa23ea06788de`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:00.943809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:00.969636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:01.027702 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1157/2321] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:01.041086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:01.043399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:01.109471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490ada-c489-4bbd-ae55-3af227d42390 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:01.114296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:01.115162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:01.115631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:01.116093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:01.122505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:01.128953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:01.130590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9887e1-ad6b-4c67-ac8d-f0f8ecfeae9c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:01.142854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1165/2322] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:01.510676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:01.512974 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:01.657364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10402f-052d-434e-a2e0-328aad958220 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:01.683225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:01.683896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:01.684175 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:01.684457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] PATH_INFO: `/v3/users/c62a7d59d7f14c37860d53079792b970` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:01.687391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62a7d59d7f14c37860d53079792b970)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:01.689922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:01.787776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62a7d59d7f14c37860d53079792b970'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:01.788563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62a7d59d7f14c37860d53079792b970'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:01.799494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62a7d59d7f14c37860d53079792b970'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:01.800907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62a7d59d7f14c37860d53079792b970'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:01.813830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62a7d59d7f14c37860d53079792b970'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:01.827843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1158/2323] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:48:01 2022] DELETE /identity/v3/users/c62a7d59d7f14c37860d53079792b970 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:01.834180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:01.834473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:01.834755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:01.855045 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:01.856253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:01.921788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1166/2324] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:01.931615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:01.933040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:01.977875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:01.993580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697d41-d3ea-41bb-a112-fc0fd996d99b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:01.997541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:01.998164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:01.998442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:01.998713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:02.009462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:02.010937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:02.021429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1159/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:02.331961 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:02.333533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:02.346992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447608-442f-43b2-9428-61a2608e69c1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:02.352886 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:02.353640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:02.353922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:02.354199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] PATH_INFO: `/v3/projects/08c9f4e58cfe412db2ec45f1444ce316` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:02.355375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c9f4e58cfe412db2ec45f1444ce316)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:02.357277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:02.413023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c9f4e58cfe412db2ec45f1444ce316', 'request_id': 'req-95466826-3b2e-496d-bb43-bef938d321ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:02.421516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c9f4e58cfe412db2ec45f1444ce316', 'request_id': 'req-95466826-3b2e-496d-bb43-bef938d321ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:02.427059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c9f4e58cfe412db2ec45f1444ce316', 'request_id': 'req-95466826-3b2e-496d-bb43-bef938d321ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:02.442053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] The token cache is being invalidate because project 08c9f4e58cfe412db2ec45f1444ce316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:02.442339 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:02.442963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95466826-3b2e-496d-bb43-bef938d321ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:02.444512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1167/2326] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:48:02 2022] DELETE /identity/v3/projects/08c9f4e58cfe412db2ec45f1444ce316 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:12.016682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=8 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:12.438765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:24.082043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:24.083533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:24.098185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb1eb0-3939-4043-bf59-edca4b212183 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:24.161937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:24.162659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.163010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.163350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] PATH_INFO: `/v3/users/fa6fe2881b1549ef8af48fa79978365f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:24.164688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6fe2881b1549ef8af48fa79978365f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:24.166908 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:24.215654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6fe2881b1549ef8af48fa79978365f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.216378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6fe2881b1549ef8af48fa79978365f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.224183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6fe2881b1549ef8af48fa79978365f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.224801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6fe2881b1549ef8af48fa79978365f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.237116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6fe2881b1549ef8af48fa79978365f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.249663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1160/2327] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:48:24 2022] DELETE /identity/v3/users/fa6fe2881b1549ef8af48fa79978365f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:24.254525 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.255005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.256437 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:24.277078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:24.278321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:24.338928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1168/2328] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:24.348560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:24.350334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:24.411860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796478-92ae-4bf5-9f5b-38cd03a0589d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:24.415563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:24.416244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.416452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.416725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:24.426154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:24.427679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c4e6-fb17-47be-b65d-81cd512d59bf service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:24.438646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1161/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:48:24.723571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:24.725691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:24.739957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18231c98-ff61-44fb-8ad5-5f0a555d773b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:24.764235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:24.765248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.765785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.766128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] PATH_INFO: `/v3/projects/0e56e57db24447d98efade34084824f7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:24.767740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e56e57db24447d98efade34084824f7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:24.776171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:24.850187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e56e57db24447d98efade34084824f7', 'request_id': 'req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.856941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e56e57db24447d98efade34084824f7', 'request_id': 'req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.863024 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e56e57db24447d98efade34084824f7', 'request_id': 'req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.881988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] The token cache is being invalidate because project 0e56e57db24447d98efade34084824f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:24.882279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.883085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-51aeb4b6-de56-4225-8af6-4b0bd885f0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:24.885318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1169/2330] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:48:24 2022] DELETE /identity/v3/projects/0e56e57db24447d98efade34084824f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:24.890992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.891335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.891468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:24.911845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:24.913058 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:24.933764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:24.976372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1162/2331] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:24.984845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:24.985235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:24.985624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.014279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:25.016915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:25.026323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1170/2332] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:48:25.031519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.044712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922246a-619a-4594-b1f9-fd9ec1a86151 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.050480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.051140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.051782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.051909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.052572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:48:25.052884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.054547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.068379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1163/2333] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:48:25.073113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.083992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cdeff-f4df-4bb0-b5e2-c3c013b4bc9c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.090467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.091245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.091529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.091829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.092505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.094488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.124265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1171/2334] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:48:25 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:48:25.128520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.138873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c64fa-92bf-48a0-a399-fd80775236b0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.203606 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.204400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.204795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.205062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.205776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.207700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.230683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1164/2335] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:48:25 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:48:25.234955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.246029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3b8e-3a3a-4676-a9c8-b2478dbedd07 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.251118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.251740 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.252018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.252343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.253034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.254685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.265687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1172/2336] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:48:25.269500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.281498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540b41-f9c9-43f8-a7ee-6cad8346774c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.286312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.286945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.287230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.287600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.288604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.290849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975274df-489c-4a9e-9b28-c8d19d4b517b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.303118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1165/2337] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:48:25.308595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.319095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf754-db3f-4780-9965-be8cb6dfc02b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.324883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.325600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.325875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.326175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] PATH_INFO: `/v3/projects/123b91c3438f4fe9abbe0e587a4ddf56/users/a19ada7814574dd7b64401d880589f9f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.343583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] RBAC: Authorizing `identity:create_grant(project_id=123b91c3438f4fe9abbe0e587a4ddf56, user_id=a19ada7814574dd7b64401d880589f9f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.346272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.368507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1173/2338] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:48:25 2022] PUT /identity/v3/projects/123b91c3438f4fe9abbe0e587a4ddf56/users/a19ada7814574dd7b64401d880589f9f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:25.379770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.380017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.380313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.409230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] MFA Rules not processed for user `a19ada7814574dd7b64401d880589f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:25.410454 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:25.476941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1166/2339] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:25.488519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.490328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:25.514715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:25.553004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c34f3-4fd7-47c9-9c9a-836e1ff9323e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.557481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.558121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.558403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.558679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.567532 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.568962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ad560-eead-4646-ba06-812786c86b38 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.578557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1174/2340] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:25.604893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.623924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:25.681939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b67f9e-b114-440d-b57b-e86697280dfb None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.686564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.687211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.687494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.687771 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] PATH_INFO: `/v3/users/a19ada7814574dd7b64401d880589f9f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.688968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19ada7814574dd7b64401d880589f9f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.690966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.737470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19ada7814574dd7b64401d880589f9f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:25.738173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19ada7814574dd7b64401d880589f9f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:25.745822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19ada7814574dd7b64401d880589f9f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:25.746441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19ada7814574dd7b64401d880589f9f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:25.759662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19ada7814574dd7b64401d880589f9f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:25.772550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1167/2341] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:48:25 2022] DELETE /identity/v3/users/a19ada7814574dd7b64401d880589f9f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:25.777325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.777659 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.777940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.799609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:25.800822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:25.878152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1175/2342] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:25.886797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:25.888533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:25.968278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938994-80b3-4ef7-be82-faec1215de18 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:25.972428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:25.973052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:25.973335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:25.973638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:25.983641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:25.985140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:25.995050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1168/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:26.379986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:26.381362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:26.409265 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db437-4c8e-4cf8-9b4c-899cd47cd809 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:26.417540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:26.418115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:26.418465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:26.418825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] PATH_INFO: `/v3/projects/123b91c3438f4fe9abbe0e587a4ddf56` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:26.420184 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=123b91c3438f4fe9abbe0e587a4ddf56)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:26.422289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:26.485601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123b91c3438f4fe9abbe0e587a4ddf56', 'request_id': 'req-e14890dc-02e3-4c50-8247-a55444b38f10'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:26.491974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123b91c3438f4fe9abbe0e587a4ddf56', 'request_id': 'req-e14890dc-02e3-4c50-8247-a55444b38f10'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:26.504268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123b91c3438f4fe9abbe0e587a4ddf56', 'request_id': 'req-e14890dc-02e3-4c50-8247-a55444b38f10'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:26.518399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] The token cache is being invalidate because project 123b91c3438f4fe9abbe0e587a4ddf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:26.518692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:26.519315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e14890dc-02e3-4c50-8247-a55444b38f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:26.520975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1176/2344] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:48:26 2022] DELETE /identity/v3/projects/123b91c3438f4fe9abbe0e587a4ddf56 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:26.953624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:26.955056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:26.968232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff696c2-7998-4bd2-943c-779b0980485d service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:27.007630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:27.027709 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:27.028347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:27.028623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:27.028893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] PATH_INFO: `/v3/users/9d36a5ab2a144438bebaa23ea06788de` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:27.030042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d36a5ab2a144438bebaa23ea06788de)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:27.031992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:27.078547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d36a5ab2a144438bebaa23ea06788de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.079202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d36a5ab2a144438bebaa23ea06788de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.086646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d36a5ab2a144438bebaa23ea06788de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.087412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d36a5ab2a144438bebaa23ea06788de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.101038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d36a5ab2a144438bebaa23ea06788de'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.113007 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1169/2345] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:48:26 2022] DELETE /identity/v3/users/9d36a5ab2a144438bebaa23ea06788de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:27.117508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:27.117797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:27.118096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:27.138214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:27.139420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:27.181459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:27.201258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1177/2346] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:27.211217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:27.212692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:27.272109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba82c4-d8c5-40f0-b19e-bdca6a55828f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:27.276298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:27.276937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:27.277219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:27.277534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:27.287173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:27.288623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71fe5-9ba1-4e22-8736-841d5d719d9e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:27.298489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1170/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:27.677127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:27.677127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:27.689917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243e01c-ca77-4901-a397-dd5068894636 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:27.702061 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:27.703402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:27.703877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:27.704500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] PATH_INFO: `/v3/projects/5794f638657e45b4aa54ba28dbcda81a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:27.705982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5794f638657e45b4aa54ba28dbcda81a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:27.708591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:27.783058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5794f638657e45b4aa54ba28dbcda81a', 'request_id': 'req-03f055a1-8dfe-4e1b-aacd-3532e98f592c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.795262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5794f638657e45b4aa54ba28dbcda81a', 'request_id': 'req-03f055a1-8dfe-4e1b-aacd-3532e98f592c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.803161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5794f638657e45b4aa54ba28dbcda81a', 'request_id': 'req-03f055a1-8dfe-4e1b-aacd-3532e98f592c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.819311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] The token cache is being invalidate because project 5794f638657e45b4aa54ba28dbcda81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:27.819705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.820479 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:27.823160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1178/2348] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:48:27 2022] DELETE /identity/v3/projects/5794f638657e45b4aa54ba28dbcda81a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:30.292303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8485e7-899c-42e7-afd3-2dc1bc4253cd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:30.292815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8485e7-899c-42e7-afd3-2dc1bc4253cd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:30.293047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8485e7-899c-42e7-afd3-2dc1bc4253cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:30.312808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-be8485e7-899c-42e7-afd3-2dc1bc4253cd None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:30.314060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-be8485e7-899c-42e7-afd3-2dc1bc4253cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:30.377986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1171/2349] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:30.421341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:30.422796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:30.492542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f055a1-8dfe-4e1b-aacd-3532e98f592c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:30.498503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:30.499131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:30.499413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:30.499680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:30.508154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:30.510449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:30.518964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1179/2350] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:48:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:48:31.071766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff3c9-118d-4316-855f-10ffdea15eeb None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.072101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff3c9-118d-4316-855f-10ffdea15eeb None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.072377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff3c9-118d-4316-855f-10ffdea15eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.085836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:31.093768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-beeff3c9-118d-4316-855f-10ffdea15eeb None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:31.095749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-beeff3c9-118d-4316-855f-10ffdea15eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:31.104919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1172/2351] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:31.120453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:31.130962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa375-53a5-45c5-90e5-e9ce09d9ebfb service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:31.136782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:31.137399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.137741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.138014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.147499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:31.149700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:31.162627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1180/2352] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:48:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 11:48:31.405332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ea5-2818-43b7-9e71-4b4d6196fd8b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.405846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ea5-2818-43b7-9e71-4b4d6196fd8b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.405924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ea5-2818-43b7-9e71-4b4d6196fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.427117 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-036d1ea5-2818-43b7-9e71-4b4d6196fd8b None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:31.428337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-036d1ea5-2818-43b7-9e71-4b4d6196fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:31.436481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1173/2353] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:31.448688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:31.461222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d27b6-1005-479b-abbb-2a8ff7c2ddb1 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:31.467331 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:31.467959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.468244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.468521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.477775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:31.479966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:31.488615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1181/2354] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:48:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:48:31.809333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.809650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.809930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.829194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:31.830416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:31.838592 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1174/2355] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:31.850174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:31.860754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2555-9a23-4c76-87cf-4cbf0f297a51 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:31.865696 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:31.866297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:31.866580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:31.866848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:31.876053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:31.877654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb9826-e59d-490b-9886-448408abf9aa service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:31.885821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1182/2356] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:48:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:48:34.020744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:34.022158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:34.089281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0ea3-9dda-427f-8065-1844fa1d87a4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:34.093864 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:34.094509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:34.094787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:34.095060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] PATH_INFO: `/v3/users/eb1af73fd4ac487fac1568cb445a511d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:34.096599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1af73fd4ac487fac1568cb445a511d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:34.098662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:34.147038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1af73fd4ac487fac1568cb445a511d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.147715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1af73fd4ac487fac1568cb445a511d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.156259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1af73fd4ac487fac1568cb445a511d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.157078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1af73fd4ac487fac1568cb445a511d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.169692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1af73fd4ac487fac1568cb445a511d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.182462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1175/2357] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:48:34 2022] DELETE /identity/v3/users/eb1af73fd4ac487fac1568cb445a511d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:34.187409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:34.187907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:34.188001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:34.207848 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:34.209091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:34.222927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:34.270925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1183/2358] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:34.281101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:34.282611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:34.341468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715e93-765f-4d02-b721-7ed0baf62423 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:34.345158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:34.345821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:34.346140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:34.346371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:34.356415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:34.357880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d7835-29f3-4fab-b494-09f1b685a47b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:34.367863 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1176/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:48:34.550262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:34.552023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:34.565452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce58e4-c5ce-4a20-abfa-0a8586219943 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:34.570165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:34.570895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:34.571172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:34.571442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] PATH_INFO: `/v3/projects/460961ebb939469c96621850ab00bd8e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:34.572591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] RBAC: Authorizing `identity:delete_project(project_id=460961ebb939469c96621850ab00bd8e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:34.575102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:34.638161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460961ebb939469c96621850ab00bd8e', 'request_id': 'req-f0a2384b-1131-4e4d-b088-c4a4211b179f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.645452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460961ebb939469c96621850ab00bd8e', 'request_id': 'req-f0a2384b-1131-4e4d-b088-c4a4211b179f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.652781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460961ebb939469c96621850ab00bd8e', 'request_id': 'req-f0a2384b-1131-4e4d-b088-c4a4211b179f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.670625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] The token cache is being invalidate because project 460961ebb939469c96621850ab00bd8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:48:34.670921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.671591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:48:34.673784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1184/2360] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:48:34 2022] DELETE /identity/v3/projects/460961ebb939469c96621850ab00bd8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:48:41.728118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dc1-fc57-400c-97cc-fcb3642e5031 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:41.728589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dc1-fc57-400c-97cc-fcb3642e5031 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:41.728690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dc1-fc57-400c-97cc-fcb3642e5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:41.751782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-02fa6dc1-fc57-400c-97cc-fcb3642e5031 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:41.753346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-02fa6dc1-fc57-400c-97cc-fcb3642e5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:41.758254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:41.816631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1177/2361] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:48:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:41.830590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:48:41.832174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:41.908763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2384b-1131-4e4d-b088-c4a4211b179f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:48:41.913899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:48:41.914557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:41.914839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:41.915181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:41.927342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:48:41.928947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eab30-a505-42ab-a99b-8dc8487d1b3c service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:48:41.939171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1185/2362] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:48:44.390249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7f6e-2224-48b9-bc96-344c2e270743 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:44.390763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7f6e-2224-48b9-bc96-344c2e270743 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:44.390851 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7f6e-2224-48b9-bc96-344c2e270743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:44.413085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e44a7f6e-2224-48b9-bc96-344c2e270743 None None] MFA Rules not processed for user `9d341bba8dda445ca4eac6d52aa9f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:44.416365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e44a7f6e-2224-48b9-bc96-344c2e270743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:44.487561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1178/2363] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:48:51.014405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085fea-f463-4d00-a5f9-d71241e8f5a5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:48:51.015000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085fea-f463-4d00-a5f9-d71241e8f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:48:51.015000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085fea-f463-4d00-a5f9-d71241e8f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:48:51.037650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ee085fea-f463-4d00-a5f9-d71241e8f5a5 None None] MFA Rules not processed for user `1a343996462b462d86fb89b876f4e127`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:48:51.038918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ee085fea-f463-4d00-a5f9-d71241e8f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:48:51.071782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:51.105261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1186/2364] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:48:54.488605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=46 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:01.097705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:02.118329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.119377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.119888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.122646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1179/2365] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:49:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:49:02.128474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030be-686e-41fc-ac5f-aa86b6dfe4b6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.129374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030be-686e-41fc-ac5f-aa86b6dfe4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.129684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030be-686e-41fc-ac5f-aa86b6dfe4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.150508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-49d030be-686e-41fc-ac5f-aa86b6dfe4b6 None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:02.151733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-49d030be-686e-41fc-ac5f-aa86b6dfe4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.232204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1187/2366] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:49:02.244937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:02.247018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.315944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b94083-9bbe-4b09-bffe-d4d54e22131f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:02.319605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:02.320220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.320494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.320763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.331274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:02.332692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd962f-979f-418f-bb9a-fc1822dec4fb service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:02.343865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1180/2367] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:49:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:49:02.422881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.423223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.423510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.425134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1188/2368] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:49:02.431652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e726-04c3-4af5-881e-36b561ebe62c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.432165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e726-04c3-4af5-881e-36b561ebe62c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.432746 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e726-04c3-4af5-881e-36b561ebe62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.455022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ba49e726-04c3-4af5-881e-36b561ebe62c None None] MFA Rules not processed for user `3fa4877f580c4c708e7a6946b5f0d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:02.456239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ba49e726-04c3-4af5-881e-36b561ebe62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.509820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1181/2369] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:49:02.522458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:02.524146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.537240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334b43-7d18-49e3-ab52-8d4cba3e5aae None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:02.541591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:02.542138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.542420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.542738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.549983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:02.551405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868e93-4c94-4544-a1d9-c412e168fd8f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:02.560005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1189/2370] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:49:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:49:02.646646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.646934 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.647211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] PATH_INFO: `/` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.648573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1182/2371] 10.222.0.60 () {54 vars in 921 bytes} [Fri Jul 29 11:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 11:49:02.653878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a58b-7cb2-4759-932a-0b1a2afa201e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.654660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a58b-7cb2-4759-932a-0b1a2afa201e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.655396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a58b-7cb2-4759-932a-0b1a2afa201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.675317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aaa8a58b-7cb2-4759-932a-0b1a2afa201e None None] MFA Rules not processed for user `a2502e6309ca4a688de48416b09d16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:02.676528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aaa8a58b-7cb2-4759-932a-0b1a2afa201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.687214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1190/2372] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Jul 29 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:49:02.697797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:02.699766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:02.713630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c01b-5577-4bb1-8762-cd3c96c20c48 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:02.717554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:02.718238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:02.718608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:02.718944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:02.730914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:02.732653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:02.743942 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1183/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:49:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:49:10.543956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:10.543956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:10.544546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:10.565035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:10.566551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:10.582141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1191/2374] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:49:10.594145 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:10.606358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8a1-816a-45bd-8ff6-a2dd2150de9e service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:10.611391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:10.612013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:10.612295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:10.612569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:10.621407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:10.623039 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debc046-6b67-495e-8a34-613c6e88e1a6 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:10.631033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1184/2375] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:49:20.559011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=43 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:20.627803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=61 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:25.635462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:25.637990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:25.731278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc989873-57f6-4a33-aa4f-844259daaaaf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:25.736348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:25.737067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:25.737462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:25.737827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:25.739632 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:25.752727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:25.754442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087be1b-4167-4d5d-981e-ca6dcc740335 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:25.767974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1192/2376] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:49:35.763028 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=32 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:37.219970 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:37.220482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:37.220598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:37.239271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] MFA Rules not processed for user `0c22bac56ed1472a9b2e7b6943736333`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:37.240475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:37.294437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1185/2377] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:49:38.996169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c86-2fad-422c-ba9e-e9823f44d9d1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:38.996628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c86-2fad-422c-ba9e-e9823f44d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:38.996733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c86-2fad-422c-ba9e-e9823f44d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:39.017018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65e16c86-2fad-422c-ba9e-e9823f44d9d1 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:49:39.018305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65e16c86-2fad-422c-ba9e-e9823f44d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:49:39.025654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1193/2378] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:49:39.048719 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:49:39.061673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8124c-df51-4255-be14-f7bba3dfb85e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:49:39.067372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:49:39.068219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:49:39.068636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:49:39.069040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:49:39.079134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:49:39.080832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24acb9-08d2-47d3-9445-efb40faeaa7f service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:49:39.091043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1186/2379] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:49:49.010645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:49.086909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=31 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:21.900731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812f06-c753-40f0-88e7-adb434e5bab6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:21.901207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812f06-c753-40f0-88e7-adb434e5bab6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:21.901398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812f06-c753-40f0-88e7-adb434e5bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:21.925377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7b812f06-c753-40f0-88e7-adb434e5bab6 None None] MFA Rules not processed for user `9d341bba8dda445ca4eac6d52aa9f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:21.926665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7b812f06-c753-40f0-88e7-adb434e5bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:21.938409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1194/2380] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:24.981017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:24.981558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:24.981674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:25.001762 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] MFA Rules not processed for user `1a343996462b462d86fb89b876f4e127`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:25.002950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:25.009759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1187/2381] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:31.916452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:34.996018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:39.769063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:39.769612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:39.769782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:39.790080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] MFA Rules not processed for user `ee3506015d9240258cbada860704dffe`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:39.791289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:39.854352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1195/2382] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:45.948654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:45.950789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:46.026208 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea497-1e37-4fbd-a846-2abac416d4e9 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.032987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.034172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.034521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.034810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] PATH_INFO: `/v3/users/0c22bac56ed1472a9b2e7b6943736333` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.036028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c22bac56ed1472a9b2e7b6943736333)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.038389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.096790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c22bac56ed1472a9b2e7b6943736333'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.097757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c22bac56ed1472a9b2e7b6943736333'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.108867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c22bac56ed1472a9b2e7b6943736333'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.109745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c22bac56ed1472a9b2e7b6943736333'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.125591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f5c6cd1e-a29c-4833-b2c9-f1b7bc06a698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c22bac56ed1472a9b2e7b6943736333'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.142619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1188/2383] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:50:45 2022] DELETE /identity/v3/users/0c22bac56ed1472a9b2e7b6943736333 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:50:46.325877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.338831 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b56ec-a8ac-4c17-977f-ea96015cea8e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.397463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.398124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.398401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.398675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] PATH_INFO: `/v3/projects/1658d63aa1b54aa5a36754e83179e317` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.399884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1658d63aa1b54aa5a36754e83179e317)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.401819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.450026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1658d63aa1b54aa5a36754e83179e317', 'request_id': 'req-833d936c-b086-40b4-bb31-8f5c70c780b8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.456614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1658d63aa1b54aa5a36754e83179e317', 'request_id': 'req-833d936c-b086-40b4-bb31-8f5c70c780b8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.464441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1658d63aa1b54aa5a36754e83179e317', 'request_id': 'req-833d936c-b086-40b4-bb31-8f5c70c780b8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.477223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] The token cache is being invalidate because project 1658d63aa1b54aa5a36754e83179e317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:50:46.477546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.478177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-833d936c-b086-40b4-bb31-8f5c70c780b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:50:46.479976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1196/2384] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:50:46 2022] DELETE /identity/v3/projects/1658d63aa1b54aa5a36754e83179e317 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:50:46.485304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.485626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.485906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.505912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:46.507106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:46.572232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1189/2385] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:46.645992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.646276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.646549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.666132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:46.667252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:46.676174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1197/2386] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:50:46.680435 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.690904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4fc4-109d-453f-85a0-fe90bbf84d21 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.695458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.696094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.696372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.696643 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.697330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:50:46.697663 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.699289 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.710882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1190/2387] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:50:46.715018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.724821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627f62b-84a8-4646-8b99-16f5078d76db None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.729513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.730118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.730422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.730680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.732134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.734076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.761716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1198/2388] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:50:46 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:50:46.766029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.775764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065f55-7a54-47e4-b2c5-cf35d2148f86 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.780020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:46.833904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.834526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.834808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.835081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.835753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.837705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.859497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1191/2389] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:50:46 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:50:46.863610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.873907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f1e6-aeb8-4a9a-bdcf-6681eed506eb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.878537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.879151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.879436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.879716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.880410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.882050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.883287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:46.896854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1199/2390] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:50:46.898070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.908854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9880b-a40c-47a5-bbb4-3793ae4e9383 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.913453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.914062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.914377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.914654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.915474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.917152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc388-ac55-4bf9-af7e-3a6496d65023 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.928202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1192/2391] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:50:46.932499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:46.942679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e09e94-767f-4f8d-9ea1-3eab3ae118ec admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:46.947333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:46.947990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.948274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.948554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] PATH_INFO: `/v3/projects/861c5a0403c94abd9ae479175604c835/users/5c56880b1a64449e8e0de42174222600/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:46.963350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861c5a0403c94abd9ae479175604c835, user_id=5c56880b1a64449e8e0de42174222600, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:46.966710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:46.979387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1200/2392] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:50:46 2022] PUT /identity/v3/projects/861c5a0403c94abd9ae479175604c835/users/5c56880b1a64449e8e0de42174222600/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:50:46.984911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde7aa-4a9c-4753-b6cc-49fc5e918da7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:46.985453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde7aa-4a9c-4753-b6cc-49fc5e918da7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:46.985550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde7aa-4a9c-4753-b6cc-49fc5e918da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:47.005092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9fbde7aa-4a9c-4753-b6cc-49fc5e918da7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:47.007149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9fbde7aa-4a9c-4753-b6cc-49fc5e918da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:47.072098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1193/2393] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:50:47.082664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:47.084341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:47.141627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b1ebc-ffb1-4415-8fca-d9d09193ef93 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:47.145301 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:47.145948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:47.146231 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:47.146506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:47.155593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:47.157002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:47.166315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1201/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:50:52.533624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:52.534113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:52.534288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:52.568718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] MFA Rules not processed for user `5c56880b1a64449e8e0de42174222600`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:52.569960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:52.648375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1194/2395] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:52.649723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:52.660304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef303a-9c18-419a-aa1e-4a95915f94c2 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:52.666177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:52.667033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:52.668006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:52.668951 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:52.669816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:52.672614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:52.712449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1202/2396] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:50:52 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:50:52.717038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:52.732384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05deb1-87dc-4d0a-9cb2-7db384fd4f56 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:52.754813 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:52.818674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:52.819368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:52.819667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:52.820639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:52.821701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:52.826219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:52.858469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1195/2397] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:50:52 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:50:52.862796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:52.878758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd8c6-6313-4ad7-adda-da05aedba929 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:52.883474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:52.884100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:52.884387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:52.884669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:52.885694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:52.887540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:52.910194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1203/2398] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:50:52.914448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:52.926447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbecc-4139-4e11-815b-afbece2d89c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:52.934595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:52.935657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:52.936044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:52.936624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] PATH_INFO: `/v3/projects/e416fabf8136411489d3964dd2af2249/users/f4e70089c2e0491d9a5acaa31d79b3c5/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:52.954308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e416fabf8136411489d3964dd2af2249, user_id=f4e70089c2e0491d9a5acaa31d79b3c5, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:52.956998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:52.983860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1196/2399] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:50:52 2022] PUT /identity/v3/projects/e416fabf8136411489d3964dd2af2249/users/f4e70089c2e0491d9a5acaa31d79b3c5/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:50:52.988236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:53.001400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1769-7567-48ea-a0d7-3ab91df82e28 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:53.063163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:53.063812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:53.064143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:53.064744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:53.065654 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:53.067274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6ca9-d5d2-4f56-9169-116ab6619b57 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:53.083378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1204/2400] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:50:53.084136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:53.096467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0626-fc42-4982-b9c4-e3737b7a5391 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:53.102392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:53.103481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:53.103963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:53.104434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] PATH_INFO: `/v3/projects/e416fabf8136411489d3964dd2af2249/users/f4e70089c2e0491d9a5acaa31d79b3c5/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:53.107455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e416fabf8136411489d3964dd2af2249, user_id=f4e70089c2e0491d9a5acaa31d79b3c5, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:53.131649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:53.149109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1197/2401] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:50:53 2022] PUT /identity/v3/projects/e416fabf8136411489d3964dd2af2249/users/f4e70089c2e0491d9a5acaa31d79b3c5/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:50:57.380939 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c99bf-9364-4d37-8ba1-1d97c476dfde None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:57.381482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c99bf-9364-4d37-8ba1-1d97c476dfde None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:57.381610 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c99bf-9364-4d37-8ba1-1d97c476dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:57.412478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-276c99bf-9364-4d37-8ba1-1d97c476dfde None None] MFA Rules not processed for user `f4e70089c2e0491d9a5acaa31d79b3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:57.413852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-276c99bf-9364-4d37-8ba1-1d97c476dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:57.443373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:57.493894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1205/2402] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:50:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:57.507649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:57.509386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:57.572977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694355d-581a-4e73-96fa-624509e95988 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:57.578182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:57.579725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:57.579725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:57.579725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:57.653675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:57.655119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:57.664892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1198/2403] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:50:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:50:57.809812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0133f-0daa-4e34-80f0-86874b06f5ff None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:57.810153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0133f-0daa-4e34-80f0-86874b06f5ff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:57.810432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0133f-0daa-4e34-80f0-86874b06f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:57.830051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aaa0133f-0daa-4e34-80f0-86874b06f5ff None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:50:57.831230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aaa0133f-0daa-4e34-80f0-86874b06f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:57.893915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1206/2404] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:50:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:50:57.943637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:50:57.945056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:50:57.976900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:58.025189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88c0-b61c-4dcc-bbb2-0fac3fc21a4e service glance] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:50:58.031138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:50:58.031889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:50:58.032168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:50:58.032438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:50:58.041449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:50:58.044061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ae70f-499e-4286-95ac-8f4277a00b87 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:50:58.053067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1199/2405] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:06.581731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:06.582225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:06.582306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:06.601721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] MFA Rules not processed for user `5c56880b1a64449e8e0de42174222600`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:06.602928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:06.611357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1207/2406] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:08.049623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=22 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:08.619427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:08.619711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:08.619980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:08.640529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:08.641761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:08.648898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1200/2407] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:08.661109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:08.673762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516d477-f27c-4135-8a26-583b9adbd68a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:08.678795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:08.679412 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:08.679692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:08.679962 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:08.689620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:08.691201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:08.699747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1208/2408] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:18.634136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:18.695997 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=51 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:19.813658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:19.875123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5818ab-f0dc-4ddb-a4b6-e572cf91addf None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:19.878912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:19.879538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:19.879820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:19.880096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:19.881880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:19.968127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:19.969780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:19.982287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1201/2409] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:21.222922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:21.233383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351d2a-2c3c-46c1-ae94-d8b6d3c458cb service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:21.237002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:21.237646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:21.237925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:21.238198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:21.239958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:21.254942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:21.256374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:21.268633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1209/2410] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:29.976442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=54 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:30.811694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:30.813389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:30.825231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662215f6-5666-4390-b963-3be75f1bfc1e service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:30.829399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:30.830451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:30.830918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:30.831523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:30.833920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:30.911069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:30.912530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:30.923409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1202/2411] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:31.263710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:31.605679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:31.607221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:31.686467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5cc7b-53d1-40b9-864b-ac47516d3cbd service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:31.690173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:31.690798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:31.691082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:31.691359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:31.693147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:31.757555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:31.758924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:31.769350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1210/2412] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:34.414368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:34.415839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:34.442168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412296fd-e30f-4fc6-bcbd-ea46ee8f4c33 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:34.452859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:34.453550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:34.453827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:34.454094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] PATH_INFO: `/v3/users/9d341bba8dda445ca4eac6d52aa9f80c` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:34.455260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d341bba8dda445ca4eac6d52aa9f80c)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:34.457212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:34.507049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d341bba8dda445ca4eac6d52aa9f80c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.507960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d341bba8dda445ca4eac6d52aa9f80c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.515327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d341bba8dda445ca4eac6d52aa9f80c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.515956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d341bba8dda445ca4eac6d52aa9f80c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.527941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-14d446b3-47c7-44e1-9bf3-ef8d4380f1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d341bba8dda445ca4eac6d52aa9f80c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.539981 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1203/2413] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:34 2022] DELETE /identity/v3/users/9d341bba8dda445ca4eac6d52aa9f80c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:34.715499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:34.727612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645371-c9dd-40ab-8bad-186e5c829194 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:34.786050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:34.786706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:34.786990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:34.787269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] PATH_INFO: `/v3/projects/106664c99e9c4a0d9a9c9c05e08a3d7f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:34.788449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=106664c99e9c4a0d9a9c9c05e08a3d7f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:34.790405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:34.841982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'request_id': 'req-d670dd55-60c4-4675-980d-37b8177fa64e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.848271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'request_id': 'req-d670dd55-60c4-4675-980d-37b8177fa64e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.850304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:34.855988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'request_id': 'req-d670dd55-60c4-4675-980d-37b8177fa64e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.870417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] The token cache is being invalidate because project 106664c99e9c4a0d9a9c9c05e08a3d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:34.870710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.871350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d670dd55-60c4-4675-980d-37b8177fa64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:34.872868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1211/2414] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:34 2022] DELETE /identity/v3/projects/106664c99e9c4a0d9a9c9c05e08a3d7f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:34.877757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:34.878046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:34.878348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:34.898040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:34.899243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:34.958158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1204/2415] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:34.966508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:34.966801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:34.967086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:34.987035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:34.988240 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:34.996353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1212/2416] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:51:35.000478 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.010622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce464b22-eb31-4d6c-9e72-ce6a02d0122d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.015198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.015805 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.016087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.016362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.017086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:51:35.017393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.019083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.020572 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:35.034362 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1205/2417] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:51:35.038924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.048225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89515a-8d28-4de7-9ad3-10cb3ac55468 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.052905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.053548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.053829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.054102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.054769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.056649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.084154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1213/2418] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:35 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:51:35.088292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.098276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fae7-186e-4a24-b22b-f617914b7816 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.154601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.155215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.155493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.155766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.156412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.158353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.180090 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1206/2419] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:35 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:35.185042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.195521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34b81-1757-47ec-b84f-6dbebb2f8726 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.200524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.201139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.201440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.201725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.202411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.204006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.214213 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1214/2420] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:35.218111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.228403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae203e-271a-46f3-8c31-cf355d6ed59c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.233567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.234173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.234450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.234722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.235433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.237015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7e05-708e-40e2-9aea-ae9c7f6700aa admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.248036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1207/2421] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:35.252209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.263232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05052ea3-b814-40c7-b4d7-261338cd36a5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.268019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.268673 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.268957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.269278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] PATH_INFO: `/v3/projects/0b2569fdaece4e29a8f10e379200b5d8/users/4201326987364009934f0a4c5905fe53/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.284358 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2569fdaece4e29a8f10e379200b5d8, user_id=4201326987364009934f0a4c5905fe53, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.287072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.299992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1215/2422] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:35 2022] PUT /identity/v3/projects/0b2569fdaece4e29a8f10e379200b5d8/users/4201326987364009934f0a4c5905fe53/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:35.311160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.311448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.311726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.340051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] MFA Rules not processed for user `4201326987364009934f0a4c5905fe53`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:35.341255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:35.404169 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1208/2423] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:35.414866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:35.416693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:35.475131 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ef77d-89d1-4592-8c75-a976174d1558 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:35.479121 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:35.479750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:35.480030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:35.480305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:35.488797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:35.490260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:35.499801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1216/2424] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:38.420518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:38.422216 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:38.486801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:38.504687 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0878017-e80b-4849-aeb4-1c6414a0a083 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:38.511046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:38.511768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:38.512045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:38.512315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:38.514072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:38.577983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:38.580140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:38.590430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1209/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:42.580068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:42.581529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:42.646120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a930-c7f4-47c6-b598-682b051343c6 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:42.649802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:42.651139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:42.651427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:42.651794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:42.653756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:42.694814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:42.723909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:42.725374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c56f4-5863-421b-b576-0293c8f8c057 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:42.735534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1217/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:43.990678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:44.084557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4d24-1964-40e7-aeef-f95e183ab860 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:44.092950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:44.093637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:44.093921 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:44.094374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] PATH_INFO: `/v3/users/4201326987364009934f0a4c5905fe53` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:44.095472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4201326987364009934f0a4c5905fe53)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:44.097493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:44.180316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4201326987364009934f0a4c5905fe53'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.181075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4201326987364009934f0a4c5905fe53'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.192873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4201326987364009934f0a4c5905fe53'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.194049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4201326987364009934f0a4c5905fe53'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.208088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4201326987364009934f0a4c5905fe53'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.221140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1210/2427] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:43 2022] DELETE /identity/v3/users/4201326987364009934f0a4c5905fe53 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:44.225774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:44.226274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:44.226367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:44.247845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:44.249073 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:44.311913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1218/2428] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:44.321929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:44.323538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:44.346026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:44.388094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada6e-86bf-41b5-a4a7-8b444d5ba551 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:44.392487 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:44.393246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:44.393626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:44.393963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:44.403978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:44.405443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147fb6-23a5-4c34-8afd-d7269780e776 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:44.415371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1211/2429] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:44.856512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:44.857738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:44.870228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf7804-d8b3-46fd-bb15-e0802a66de95 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:44.874889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:44.875548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:44.875820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:44.876099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] PATH_INFO: `/v3/projects/0b2569fdaece4e29a8f10e379200b5d8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:44.877255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2569fdaece4e29a8f10e379200b5d8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:44.879203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:44.949949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2569fdaece4e29a8f10e379200b5d8', 'request_id': 'req-176b95f0-000f-43fd-93d0-b7efa7d01b0a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.959309 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2569fdaece4e29a8f10e379200b5d8', 'request_id': 'req-176b95f0-000f-43fd-93d0-b7efa7d01b0a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.976694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2569fdaece4e29a8f10e379200b5d8', 'request_id': 'req-176b95f0-000f-43fd-93d0-b7efa7d01b0a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.993591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] The token cache is being invalidate because project 0b2569fdaece4e29a8f10e379200b5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:44.994098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.994771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-176b95f0-000f-43fd-93d0-b7efa7d01b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:44.997164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1219/2430] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:44 2022] DELETE /identity/v3/projects/0b2569fdaece4e29a8f10e379200b5d8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:45.002101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.002595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.002717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.024737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:45.026294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:45.115460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1212/2431] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:45.123622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.123912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.124196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.150269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:45.152800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:45.167169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1220/2432] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:45.168689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.180964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9ce1a-1278-4425-a7b1-c78ccaa95713 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.185994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.186626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.187098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.187533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.188389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:51:45.188868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.190552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.207238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1213/2433] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:51:45.211493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.224992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66118eff-ffaa-4067-a20a-2188f1144c08 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.233650 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.234541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.234909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.239031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.239861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.260547 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.297211 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1221/2434] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:45.301628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.312990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4836-d436-4755-ba98-91d923ba31b7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.378958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.379594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.379876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.380152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.380826 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.383587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.413680 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1214/2435] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:51:45.414956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.432539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ac2d-aa67-41a2-a255-a83054ee22a5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.440806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.441622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.442151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.442580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.443409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.445156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.461989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1222/2436] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:45.462450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.473899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177b08-1e63-4e55-87fe-43c59b8abc06 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.479288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.479937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.480389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.480666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.481374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.483138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444a4e7-89ce-4e95-9e78-cbcd62c2f707 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.496730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1215/2437] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:45.501225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.517318 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f65496-7bdc-4211-adb9-6da74e615ab0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.524419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.526169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.527763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.528827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] PATH_INFO: `/v3/projects/b825f9588f684579a15e1479a8822680/users/cc16d00082c64798b2486cac015d52d3/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.554866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b825f9588f684579a15e1479a8822680, user_id=cc16d00082c64798b2486cac015d52d3, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.558986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.561880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:45.577675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1223/2438] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:45 2022] PUT /identity/v3/projects/b825f9588f684579a15e1479a8822680/users/cc16d00082c64798b2486cac015d52d3/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:45.588969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.589334 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.589617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.624189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] MFA Rules not processed for user `cc16d00082c64798b2486cac015d52d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:45.625323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:45.641809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:45.725459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1216/2439] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:45.729194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.828515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367555ae-7ac0-4352-8ea0-615cae2bc009 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:45.837894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:45.839445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:45.839914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:45.840226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:45.840963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:45.843544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:45.882303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1224/2440] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:45.887344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:45.914645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40981981-1e07-418e-9dfe-82e04eb69dde None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.026322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.026965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.027245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.027533 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.028320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.030658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.057232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1217/2441] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:45 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:46.061409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.074544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f16911-ffdf-40a0-bb9d-14a51c5c70fa admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.079737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.080678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.081064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.081489 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.082295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.084244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.099949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1225/2442] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:46.101154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.112089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181612-9d6a-4414-b64e-79094686c1db admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.118197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.119796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.120255 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.121089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] PATH_INFO: `/v3/projects/62f12ea4dedb46139ae662528fb55175/users/5c4548840282451596796fc72534c72b/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.147776 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f12ea4dedb46139ae662528fb55175, user_id=5c4548840282451596796fc72534c72b, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.152798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.179453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1218/2443] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:46 2022] PUT /identity/v3/projects/62f12ea4dedb46139ae662528fb55175/users/5c4548840282451596796fc72534c72b/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:46.185122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.215616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4df4-853d-406f-be99-9abe2d3b9e26 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.331030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.332480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.332953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.333468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.334422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.336228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a8774-38ee-4e03-a9d0-649ed18061b1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.352427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1226/2444] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:46.353096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.367023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdcbcf-8243-4c43-94c5-85d871f7984b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.372286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.373157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.373488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.373766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] PATH_INFO: `/v3/projects/62f12ea4dedb46139ae662528fb55175/users/5c4548840282451596796fc72534c72b/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.380285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f12ea4dedb46139ae662528fb55175, user_id=5c4548840282451596796fc72534c72b, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.384237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.401994 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1219/2445] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:46 2022] PUT /identity/v3/projects/62f12ea4dedb46139ae662528fb55175/users/5c4548840282451596796fc72534c72b/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:46.421314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.421828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.422243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.473474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] MFA Rules not processed for user `5c4548840282451596796fc72534c72b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:46.475569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:46.547828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:46.572542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1227/2446] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:46.583243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.586430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:46.660649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73f3c-dab2-4277-9188-6c6208c5e98b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.664297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.665127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.665256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.665618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.675637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.677083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.688930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1220/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:46.787958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:46.798312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6729ae-30d6-4617-a9a0-9a18c4b2142d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:46.804034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:46.804945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:46.805228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:46.805645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:46.877548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:46.878985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6f9b1-f5c7-4742-a2bb-351243df3d5c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:46.894018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1228/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:48.066740 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:48.068293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:48.083556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:48.141402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc638-a5d0-45b7-8508-4b60ad39ecad service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:48.146880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:48.147511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:48.147791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:48.148063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:48.149904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:48.165024 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:48.167352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:48.177345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1221/2449] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:50.659385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:50.659885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:50.659966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:50.679166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] MFA Rules not processed for user `1a343996462b462d86fb89b876f4e127`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:50.680360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:50.737155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1229/2450] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:51.042739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:51.044267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:51.054661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b51d0-e1c6-4254-b9cb-927e6480035a service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:51.058627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:51.059237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:51.059513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:51.059782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:51.061498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:51.070815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:51.073074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:51.080956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1222/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:51.395110 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:51.396621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:51.484663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a41ed-16cc-48a3-9e8e-018152b4a250 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:51.496600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:51.497248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:51.497631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:51.497908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:51.499810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:51.512747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:51.514586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c5452-094d-461a-9fea-d8f61c1088c4 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:51.524751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1230/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:51.992915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:52.061395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b465c-ff2b-4002-9b8c-69500c5d834a service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:52.065990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:52.066661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:52.067077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:52.067360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] PATH_INFO: `/v3/users/cc16d00082c64798b2486cac015d52d3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:52.068526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc16d00082c64798b2486cac015d52d3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:52.070523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:52.121474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc16d00082c64798b2486cac015d52d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.122266 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc16d00082c64798b2486cac015d52d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.129998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc16d00082c64798b2486cac015d52d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.130645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc16d00082c64798b2486cac015d52d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.143926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc16d00082c64798b2486cac015d52d3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.156485 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1223/2453] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:51 2022] DELETE /identity/v3/users/cc16d00082c64798b2486cac015d52d3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:52.161034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:52.161557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:52.161648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:52.182776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:52.183985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:52.201261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:52.244473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1231/2454] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:52.254401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:52.255801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:52.278345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:52.317263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33784-d9ef-4421-82d3-65f86c528e93 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:52.320902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:52.321553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:52.322448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:52.322726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:52.331587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:52.333025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:52.342476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1224/2455] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:52.770622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:52.772054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:52.784863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c0555-896b-4c46-b5a5-4f5286288469 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:52.789781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:52.790612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:52.791046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:52.791395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] PATH_INFO: `/v3/projects/b825f9588f684579a15e1479a8822680` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:52.792784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b825f9588f684579a15e1479a8822680)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:52.794734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:52.842966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b825f9588f684579a15e1479a8822680', 'request_id': 'req-dd831b2d-c4a6-43d1-93cf-52e24348e3af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.849139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b825f9588f684579a15e1479a8822680', 'request_id': 'req-dd831b2d-c4a6-43d1-93cf-52e24348e3af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.854758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b825f9588f684579a15e1479a8822680', 'request_id': 'req-dd831b2d-c4a6-43d1-93cf-52e24348e3af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.867833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] The token cache is being invalidate because project b825f9588f684579a15e1479a8822680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:52.868124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.869364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:52.871596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1232/2456] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:52 2022] DELETE /identity/v3/projects/b825f9588f684579a15e1479a8822680 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:51:52.875112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:52.885604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa50d0-7388-4c1e-8dab-c86128529536 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:52.945156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:52.945850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:52.946131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:52.946405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] PATH_INFO: `/v3/users/5c4548840282451596796fc72534c72b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:52.948021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4548840282451596796fc72534c72b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:52.950006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.000368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4548840282451596796fc72534c72b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.001026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4548840282451596796fc72534c72b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.010660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4548840282451596796fc72534c72b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.011385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4548840282451596796fc72534c72b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.023659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cd7b5f50-bceb-44b8-9350-f7b827de2e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4548840282451596796fc72534c72b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.036657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1225/2457] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:52 2022] DELETE /identity/v3/users/5c4548840282451596796fc72534c72b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:51:53.333524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.335002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:53.362914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd831b2d-c4a6-43d1-93cf-52e24348e3af admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:53.432286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:53.432956 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.433241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.433557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] PATH_INFO: `/v3/projects/62f12ea4dedb46139ae662528fb55175` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.434749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f12ea4dedb46139ae662528fb55175)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:53.436689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.514205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:53.515712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f12ea4dedb46139ae662528fb55175', 'request_id': 'req-652d97be-9e8f-476e-af39-7a1be58803b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.525292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f12ea4dedb46139ae662528fb55175', 'request_id': 'req-652d97be-9e8f-476e-af39-7a1be58803b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.532052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f12ea4dedb46139ae662528fb55175', 'request_id': 'req-652d97be-9e8f-476e-af39-7a1be58803b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.546512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] The token cache is being invalidate because project 62f12ea4dedb46139ae662528fb55175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:53.546802 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.547491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-652d97be-9e8f-476e-af39-7a1be58803b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:53.549112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1233/2458] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:53 2022] DELETE /identity/v3/projects/62f12ea4dedb46139ae662528fb55175 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:53.554219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.554693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.554787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.578713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:53.579944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:53.623077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:53.657465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1226/2459] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:53.660249 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.660464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.661396 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.684029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:53.685251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:53.694129 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1234/2460] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:53.699034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.709021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30d9c5-5a3b-4e80-8fdf-c96340696687 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:53.715028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:53.715736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.716091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.716437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.717403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:51:53.717807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:53.719430 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.732284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1227/2461] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:51:53.737258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.748445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8780e-083c-475a-b0eb-aba08535e57c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:53.754092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:53.754898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.755136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.755415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.756168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:53.758102 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.802707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1235/2462] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:53 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:53.807841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.818005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817167-6c80-4499-b4c6-52f61341d5dd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:53.885922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:53.886554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.886901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.887238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.887909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:53.890074 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.925861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1228/2463] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:53 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:53.929228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.944621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cda3f-e267-4b80-8397-381137e049cc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:53.962422 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:53.963212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:53.963494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:53.963780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:53.964483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:53.966204 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:53.979845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1236/2464] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:51:53.983455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:53.995446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d49ddb-fd5e-45f5-aab0-5e4f88bbca67 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.003898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.004538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.004814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.005086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.005828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.007451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527c3b-8972-4bbe-a41d-ad829ca975b5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.019502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1229/2465] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:54.023682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.034577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56831f-358a-41e8-aae3-3557a6ad589f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.039787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.041506 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.041972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.042248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] PATH_INFO: `/v3/projects/8aa117205762492592d719d70d3ed388/users/3683a4b0126b47429bd83e41fd0ae69f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.062614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa117205762492592d719d70d3ed388, user_id=3683a4b0126b47429bd83e41fd0ae69f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.065271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.080710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1237/2466] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:54 2022] PUT /identity/v3/projects/8aa117205762492592d719d70d3ed388/users/3683a4b0126b47429bd83e41fd0ae69f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:54.093143 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.093444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.093745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.128996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] MFA Rules not processed for user `3683a4b0126b47429bd83e41fd0ae69f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:54.130468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:54.237128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1230/2467] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:54.241852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.309648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17102-7f6c-45f0-be17-aff314716eda admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.314690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.315561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.315846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.316821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.317552 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.319906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.350723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1238/2468] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:54 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:51:54.354641 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.366494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4536ea-2438-4b27-ab72-cb29d58156f2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.403229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:54.428275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.428987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.429276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.429580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.430265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.433449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.456059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1231/2469] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:54 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:51:54.459983 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.471270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98f0b-69c7-4bd2-9b95-5278a21c8ff1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.476118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.476737 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.477021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.477297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.478192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.479814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.493925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1239/2470] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:54.495678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.506101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1a0fd-7f6a-43ba-bab7-3bdc7ed027c1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.512072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.512512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.512923 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.513207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] PATH_INFO: `/v3/projects/81b7cacbbf64459696b0f5e3b04af979/users/02e5ac4238ad44fd9b51a4ca8baa41c5/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.531109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b7cacbbf64459696b0f5e3b04af979, user_id=02e5ac4238ad44fd9b51a4ca8baa41c5, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.533917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.547531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1232/2471] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:54 2022] PUT /identity/v3/projects/81b7cacbbf64459696b0f5e3b04af979/users/02e5ac4238ad44fd9b51a4ca8baa41c5/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:54.551645 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.562320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6394-298c-4fa0-9413-2094066f3669 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.608026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:54.624096 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.624808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.625152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.625512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.626268 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.627935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf226-b1a2-4920-853f-9c2f72df01df admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.642313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1240/2472] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:54.643526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.654862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412520ca-3cf5-44bc-8725-12cb58df7549 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.659520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.660180 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.660463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.660738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] PATH_INFO: `/v3/projects/81b7cacbbf64459696b0f5e3b04af979/users/02e5ac4238ad44fd9b51a4ca8baa41c5/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.662722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b7cacbbf64459696b0f5e3b04af979, user_id=02e5ac4238ad44fd9b51a4ca8baa41c5, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.665717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.675924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1233/2473] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:54 2022] PUT /identity/v3/projects/81b7cacbbf64459696b0f5e3b04af979/users/02e5ac4238ad44fd9b51a4ca8baa41c5/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:54.686166 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.686378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.686660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.715020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] MFA Rules not processed for user `02e5ac4238ad44fd9b51a4ca8baa41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:54.716237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:54.784038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1241/2474] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:54.794716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:54.796384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:54.859302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0fb0b-5704-42dc-bd6f-7e932d924d7a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:54.863029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:54.863656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:54.863936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:54.864209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:54.873751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:54.875190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912e5e-2aac-4a45-b487-51077a7443db service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:54.885707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1234/2475] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:55.432946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:55.497139 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f8b54-35bc-4abb-8ec3-64bbc1404fd4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:55.501792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:55.502439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:55.502723 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:55.503018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] PATH_INFO: `/v3/users/3683a4b0126b47429bd83e41fd0ae69f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:55.504167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3683a4b0126b47429bd83e41fd0ae69f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:55.506128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:55.558347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3683a4b0126b47429bd83e41fd0ae69f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:55.559270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3683a4b0126b47429bd83e41fd0ae69f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:55.566199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3683a4b0126b47429bd83e41fd0ae69f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:55.574582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3683a4b0126b47429bd83e41fd0ae69f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:55.575239 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3683a4b0126b47429bd83e41fd0ae69f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:55.580691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:55.596205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1242/2476] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:55 2022] DELETE /identity/v3/users/3683a4b0126b47429bd83e41fd0ae69f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:55.600573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:55.600889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:55.601164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:55.620932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:55.622152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:55.683710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1235/2477] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:55.693227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:55.694655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:55.753735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a1cac-85a0-4472-9c46-2b97f188f0f6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:55.759470 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:55.760420 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:55.760895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:55.761257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:55.772626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:55.774228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:55.785070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1243/2478] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:51:56.155696 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:56.157763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:56.171421 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc65f-f497-4fef-b7d7-faf794dbceda None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:56.176753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:56.177471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.177885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.178178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] PATH_INFO: `/v3/projects/8aa117205762492592d719d70d3ed388` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:56.179456 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa117205762492592d719d70d3ed388)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:56.181766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:56.246234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:56.272707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa117205762492592d719d70d3ed388', 'request_id': 'req-c7a71203-5fc6-4230-b04d-f2dfe355532f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.281859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa117205762492592d719d70d3ed388', 'request_id': 'req-c7a71203-5fc6-4230-b04d-f2dfe355532f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.292434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa117205762492592d719d70d3ed388', 'request_id': 'req-c7a71203-5fc6-4230-b04d-f2dfe355532f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.309332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] The token cache is being invalidate because project 8aa117205762492592d719d70d3ed388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:56.309848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.310627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c7a71203-5fc6-4230-b04d-f2dfe355532f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.312425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1236/2479] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:56 2022] DELETE /identity/v3/projects/8aa117205762492592d719d70d3ed388 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:56.316400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:56.327085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de9ea4-1cef-4f75-a997-37cf7452bdbf service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:56.398390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:56.399165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.399452 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.399765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] PATH_INFO: `/v3/users/02e5ac4238ad44fd9b51a4ca8baa41c5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:56.401220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e5ac4238ad44fd9b51a4ca8baa41c5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:56.403766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:56.463700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e5ac4238ad44fd9b51a4ca8baa41c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.464471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e5ac4238ad44fd9b51a4ca8baa41c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.474946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e5ac4238ad44fd9b51a4ca8baa41c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.482763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e5ac4238ad44fd9b51a4ca8baa41c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.483497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e5ac4238ad44fd9b51a4ca8baa41c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.503981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1244/2480] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:51:56 2022] DELETE /identity/v3/users/02e5ac4238ad44fd9b51a4ca8baa41c5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:51:56.605757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.606147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.606336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:56.627314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:56.628517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:56.688652 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1237/2481] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:56.701352 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:56.702801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:56.715597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:56.784672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cf56a-b5dd-4d51-945d-809132fd2929 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:56.789972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:56.791857 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:56.792867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:56.793573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.794019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.794390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:56.815822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:56.817568 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7321-334b-43d7-89ff-597ff2328558 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:56.828564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1245/2482] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:51:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:56.874832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ea2a-fb4a-4cc4-83aa-5d2ed4c17ae2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:56.881546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:56.882481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.883012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.883451 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] PATH_INFO: `/v3/projects/81b7cacbbf64459696b0f5e3b04af979` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:56.886523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b7cacbbf64459696b0f5e3b04af979)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:56.887834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:56.949193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b7cacbbf64459696b0f5e3b04af979', 'request_id': 'req-43d1cfef-cb00-4799-800f-00d5da9e08a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.956676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b7cacbbf64459696b0f5e3b04af979', 'request_id': 'req-43d1cfef-cb00-4799-800f-00d5da9e08a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.962565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:56.968144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b7cacbbf64459696b0f5e3b04af979', 'request_id': 'req-43d1cfef-cb00-4799-800f-00d5da9e08a6'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.985853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] The token cache is being invalidate because project 81b7cacbbf64459696b0f5e3b04af979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:51:56.986131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.986749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-43d1cfef-cb00-4799-800f-00d5da9e08a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:51:56.988681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1238/2483] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:51:56 2022] DELETE /identity/v3/projects/81b7cacbbf64459696b0f5e3b04af979 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:51:56.993236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:56.993680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:56.993963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.020071 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:57.021277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:57.112355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1246/2484] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:57.116516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.116799 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.117094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.141945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:57.143128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:57.154836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1239/2485] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:57.155920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.168612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc52d39-4bd4-41b1-8f1b-8bc5dbb8e048 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.173757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.174761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.175458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.175644 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.177064 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:51:57.177377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.179665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.196574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1247/2486] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:51:57.198653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.209149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bfa8-fbcd-4e31-9bba-9a2c35ddc93f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.214624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.215256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.215538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.215881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.216552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.218519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.260422 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1240/2487] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:51:57 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:57.261464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.273623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f045c0-b3da-47e6-b313-656559b28180 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.372427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.373078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.373359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.373663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.374364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.376273 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.404876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1248/2488] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:51:57 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:51:57.409926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.428464 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e901-f346-406a-9abf-af53f79a862c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.440946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.442975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.443345 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.443685 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.444472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.448722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.463189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1241/2489] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:57.464478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.479621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64484c63-daa2-4465-a57f-f89a2308b843 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.484566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.485277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.485772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.486122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.486912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.488619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967579d8-29be-4cf4-ab44-d211642df81a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.507694 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1249/2490] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:51:57.509279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.528394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbf855-1ce2-49fe-a336-c569526e221a admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.540968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.542715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.543678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.544176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] PATH_INFO: `/v3/projects/e1903187794940588bb04aa38014b3bc/users/38fb4216709f456e8deb0e0b10d07514/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.567368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1903187794940588bb04aa38014b3bc, user_id=38fb4216709f456e8deb0e0b10d07514, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.570290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.605795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1242/2491] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:51:57 2022] PUT /identity/v3/projects/e1903187794940588bb04aa38014b3bc/users/38fb4216709f456e8deb0e0b10d07514/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:51:57.619366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.619669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.620013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.628858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:57.660759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] MFA Rules not processed for user `38fb4216709f456e8deb0e0b10d07514`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:51:57.662566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:57.745105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1250/2492] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:51:57.759261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:51:57.761678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:51:57.846436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3703-5cea-4463-8f39-0afa263e3684 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:51:57.850492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:51:57.851202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:51:57.851549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:51:57.851894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:51:57.863917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:51:57.865396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:51:57.877882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1243/2493] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:51:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:52:05.139594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:05.141372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:05.234319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e493-9dfe-47ad-be08-dbcf07f7a821 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:05.240162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:05.240934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:05.241307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:05.241679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:05.244284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:05.258101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:05.260193 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37fae-1555-45a9-8282-ac3b9919ad88 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:05.287495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1251/2494] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:07.870876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:10.083415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:10.085296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:10.104749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42f2a-92fc-4374-aca9-123f1664d31d service glance] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:10.111001 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:10.112185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:10.112185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:10.112529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:10.114646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:10.132985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:10.136634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:10.162637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1244/2495] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:12.091295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:12.091768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:12.091872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:12.110919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:12.112111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:12.166561 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1252/2496] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:12.178484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:12.179892 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:12.246588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f6cf-9819-4688-acad-645690426e89 service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:12.251501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:12.252104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:12.252379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:12.252647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:12.261220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:12.262824 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a4ae-5282-440a-bbe4-256f7ae19b4d service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:12.270717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1245/2497] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:14.997021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:15.026384 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:15.063907 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd9e2a-b822-42d3-8562-a66c40cbffda None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:15.069220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:15.070160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.070549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.071592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] PATH_INFO: `/v3/users/38fb4216709f456e8deb0e0b10d07514` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:15.073123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fb4216709f456e8deb0e0b10d07514)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:15.075199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:15.126478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fb4216709f456e8deb0e0b10d07514'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.127218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fb4216709f456e8deb0e0b10d07514'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.143798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fb4216709f456e8deb0e0b10d07514'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.154810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fb4216709f456e8deb0e0b10d07514'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.155446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fb4216709f456e8deb0e0b10d07514'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.181293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1253/2498] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:14 2022] DELETE /identity/v3/users/38fb4216709f456e8deb0e0b10d07514 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:15.183066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.183604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.183721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:15.204209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:15.205511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:15.276982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:15.291973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:15.293774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:15.360473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0308d8-3a7d-45b4-956d-4e27742e6d6f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:15.364607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:15.365360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.365780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.366159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:15.376773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:15.378413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085c5de-bcc0-42a6-9619-674ab7940269 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:15.389846 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1254/2500] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:15.761018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:15.762616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:15.778426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410af1b-262c-4759-a563-bb9b40109f62 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:15.782736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:15.783672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.783956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.784230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] PATH_INFO: `/v3/projects/e1903187794940588bb04aa38014b3bc` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:15.785569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1903187794940588bb04aa38014b3bc)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:15.787568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:15.847139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1903187794940588bb04aa38014b3bc', 'request_id': 'req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.859339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1903187794940588bb04aa38014b3bc', 'request_id': 'req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.868301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1903187794940588bb04aa38014b3bc', 'request_id': 'req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.877029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:15.881010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] The token cache is being invalidate because project e1903187794940588bb04aa38014b3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:15.881724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.882957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ba1b69fe-2d23-4a4e-8c0c-6c4838f5348c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:15.885510 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1247/2501] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:15 2022] DELETE /identity/v3/projects/e1903187794940588bb04aa38014b3bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:15.890780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.891132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.891413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:15.915718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:15.916988 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:15.966046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:15.986091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1255/2502] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:15.994630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:15.994930 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:15.995176 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.016442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:16.017613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:16.026137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1248/2503] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:16.032625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.043923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a55792-2992-4f2b-ab88-85e9ad303101 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.049564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.050719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.051313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.052145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.053582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:52:16.054243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.057841 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.080534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1256/2504] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:52:16.081736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.091815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79af34-3a30-4fb7-8ca3-15cd0552b82f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.096594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.097218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.097531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.097890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.098661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.100578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.136543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1249/2505] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:16 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:16.137821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.148482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2ea0-64be-413a-b561-51292568fcdb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.213731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.214727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.215185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.215620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.216621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.219059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.242056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1257/2506] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:16 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:16.246412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.257144 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72a3fd-e929-4f2f-9f39-a0667d5b5c93 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.262095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.262748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.263070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.263410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.264151 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.265823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.279231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1250/2507] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:52:16.283113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.295143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4099-ebb5-479f-91da-d852c6f1ac92 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.301562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.302367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.302715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.303144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.304173 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.306570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863acc34-77e0-474f-8b1a-594eacb14ffa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.318393 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1258/2508] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:52:16.323119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.333179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591888d-c17c-4019-a19c-e448f6704f0c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.338179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.338869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.339152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.339429 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] PATH_INFO: `/v3/projects/e0dae8a4ec654f2891dcbb9843932408/users/4ca035ba97604d36ae27306c246597e9/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.356194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dae8a4ec654f2891dcbb9843932408, user_id=4ca035ba97604d36ae27306c246597e9, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.359301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.375874 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1251/2509] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:16 2022] PUT /identity/v3/projects/e0dae8a4ec654f2891dcbb9843932408/users/4ca035ba97604d36ae27306c246597e9/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:16.388235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.388581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.388864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.419232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] MFA Rules not processed for user `4ca035ba97604d36ae27306c246597e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:16.420483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:16.489837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1259/2510] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:16.494926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.566023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220fc6a-5e77-469f-b752-f2676f6927c2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.570873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.572402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.572688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.572963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.573681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.575611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.609486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1252/2511] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:16 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:16.612290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.635236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db5bf2-b1a1-4188-8aa6-466d9cf999bf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.694794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:16.719040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.719935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.720320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.721034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.721842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.724152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.751494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1260/2512] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:16 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:16.755791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.767838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7c31-2bc2-417c-be5b-45904d446933 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.773632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.775233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.775620 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.776113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.777877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.779622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.793226 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1253/2513] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:52:16.797243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.808946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e7678-61c8-43a5-8b64-94a8bd0b2046 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.822944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.823570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.823857 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.824138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] PATH_INFO: `/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e/users/46e574e561314453a3de3f29864dfb99/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.842494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b51bf1cca6c4fcc9dbab6aa71d1a21e, user_id=46e574e561314453a3de3f29864dfb99, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.845168 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:16.860775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1261/2514] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:16 2022] PUT /identity/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e/users/46e574e561314453a3de3f29864dfb99/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:16.864581 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:16.880973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23437-0eaf-4cff-9021-5b3652144e1f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:16.968587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:16.969221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:16.969542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:16.970402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:16.970550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:16.972439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea929ae-5371-461c-a09a-2485026062cf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:17.000297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1254/2515] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:17.004759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:17.017196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ab0ee-1e8d-4b16-9297-f772d4ad54f5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:17.022762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:17.023535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:17.024426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:17.024766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] PATH_INFO: `/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e/users/46e574e561314453a3de3f29864dfb99/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:17.026863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b51bf1cca6c4fcc9dbab6aa71d1a21e, user_id=46e574e561314453a3de3f29864dfb99, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:17.029620 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:17.041828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1262/2516] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:17 2022] PUT /identity/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e/users/46e574e561314453a3de3f29864dfb99/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:17.109596 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:17.109828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:17.110073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:17.125070 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:17.142114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] MFA Rules not processed for user `46e574e561314453a3de3f29864dfb99`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:17.143327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:17.226637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1255/2517] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:17.238303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:17.240000 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:17.303008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93917a90-5454-4181-adba-b870e19f0191 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:17.307528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:17.308236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:17.308583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:17.308923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:17.368578 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:17.370183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d4c7-f6c3-41de-8332-0812751e04b5 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:17.379683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1263/2518] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:20.030402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:20.098126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592b6f-49ff-4b8e-bfc6-dbb17ba8f367 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:20.103340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:20.103997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:20.104365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:20.104639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] PATH_INFO: `/v3/users/4ca035ba97604d36ae27306c246597e9` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:20.105853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca035ba97604d36ae27306c246597e9)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:20.107812 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:20.173439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca035ba97604d36ae27306c246597e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.174096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca035ba97604d36ae27306c246597e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.183317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca035ba97604d36ae27306c246597e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.183968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca035ba97604d36ae27306c246597e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.206585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca035ba97604d36ae27306c246597e9'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.220642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1256/2519] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:20 2022] DELETE /identity/v3/users/4ca035ba97604d36ae27306c246597e9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:20.225804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:20.226364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:20.226688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:20.248053 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:20.249439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:20.303372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:20.323778 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1264/2520] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:20.333578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:20.335049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:20.349543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:20.398276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed3d8-9421-469e-afe6-6b50aef45ca1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:20.402897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:20.403598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:20.403955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:20.404288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:20.414406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:20.416183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:20.426013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1257/2521] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:20.862937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:20.864442 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:20.877473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e44a1-f87d-4fd3-9738-b8d40162d022 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:20.882112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:20.882812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:20.883631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:20.883897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] PATH_INFO: `/v3/projects/e0dae8a4ec654f2891dcbb9843932408` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:20.885615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0dae8a4ec654f2891dcbb9843932408)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:20.887569 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:20.955229 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0dae8a4ec654f2891dcbb9843932408', 'request_id': 'req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.963253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0dae8a4ec654f2891dcbb9843932408', 'request_id': 'req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.969481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0dae8a4ec654f2891dcbb9843932408', 'request_id': 'req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.985529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] The token cache is being invalidate because project e0dae8a4ec654f2891dcbb9843932408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:20.985921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.986824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:20.988648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1265/2522] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:20 2022] DELETE /identity/v3/projects/e0dae8a4ec654f2891dcbb9843932408 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:20.992723 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.002665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670038-3982-4a55-b45c-2040c5d7782f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.064865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.065598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.065944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.066223 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] PATH_INFO: `/v3/users/46e574e561314453a3de3f29864dfb99` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.067514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e574e561314453a3de3f29864dfb99)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.069753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.120316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e574e561314453a3de3f29864dfb99'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.121030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e574e561314453a3de3f29864dfb99'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.135100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e574e561314453a3de3f29864dfb99'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.135983 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e574e561314453a3de3f29864dfb99'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.148409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ce004ef6-930f-43b4-ae36-3a8fdcf9dfd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e574e561314453a3de3f29864dfb99'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.161462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1258/2523] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:20 2022] DELETE /identity/v3/users/46e574e561314453a3de3f29864dfb99 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:52:21.439364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.440869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:21.454943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fff85-4cb0-4199-b155-633fa7d4f8cb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.512300 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.512954 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.513258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.513560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] PATH_INFO: `/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.514719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b51bf1cca6c4fcc9dbab6aa71d1a21e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.516621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.561900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b51bf1cca6c4fcc9dbab6aa71d1a21e', 'request_id': 'req-4e95dbc4-e8c5-4932-9ff4-09913723045a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.567991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b51bf1cca6c4fcc9dbab6aa71d1a21e', 'request_id': 'req-4e95dbc4-e8c5-4932-9ff4-09913723045a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.573933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b51bf1cca6c4fcc9dbab6aa71d1a21e', 'request_id': 'req-4e95dbc4-e8c5-4932-9ff4-09913723045a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.585971 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] The token cache is being invalidate because project 5b51bf1cca6c4fcc9dbab6aa71d1a21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:21.586303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.586946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e95dbc4-e8c5-4932-9ff4-09913723045a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:21.588497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1266/2524] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:21 2022] DELETE /identity/v3/projects/5b51bf1cca6c4fcc9dbab6aa71d1a21e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:21.593727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.594140 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.594486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.616755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:21.619219 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:21.647904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:21.681010 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1259/2525] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:21.688505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.688793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.689072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.696968 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:21.710875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:21.712929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:21.721138 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1267/2526] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:21.725585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.736250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac817-390b-423a-98f6-dce4d736b246 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.741030 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.741691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.741973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.742260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.743640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:52:21.743944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.745587 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.757239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1260/2527] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:52:21.761874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.771169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e7f9-00d0-466a-b5ce-1a991e2ae215 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.775858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.776474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.776757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.777037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.777768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.779670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.809754 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1268/2528] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:21 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:52:21.814072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.826059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7caac0-e963-4f57-a75e-8390f87a4fbe admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.892017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.892684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.893126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.893409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.894178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.896267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.922113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1261/2529] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:21 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:52:21.923472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.934757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc400e-703d-44e3-a913-a7bc9ebfc56d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.940669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.941296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.941690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.942005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.942633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.944237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.957775 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1269/2530] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:21.959022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:21.970529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a42e-f378-483a-8442-ffd981f1c625 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:21.975286 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:21.976050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:21.976394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:21.977308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:21.978265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:21.979903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bca92-30a1-442d-b581-0b2896db0d26 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:21.990700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1262/2531] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:21.995514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.006332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5bd7-9eec-484e-91d4-62d735bf82cf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.012066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.012821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.013290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.013584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] PATH_INFO: `/v3/projects/2476f933bbd74a9e84abc76549305e5b/users/a7ea0cb4bb50496f9265b55b6c16cf47/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.034651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2476f933bbd74a9e84abc76549305e5b, user_id=a7ea0cb4bb50496f9265b55b6c16cf47, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.037321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.052371 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1270/2532] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:21 2022] PUT /identity/v3/projects/2476f933bbd74a9e84abc76549305e5b/users/a7ea0cb4bb50496f9265b55b6c16cf47/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:22.064232 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.064516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.064839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.092539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] MFA Rules not processed for user `a7ea0cb4bb50496f9265b55b6c16cf47`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:22.093699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:22.166159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1263/2533] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:22.170609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.231945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ca33-5478-40b2-bc7d-18e9e66d6655 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.236623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.237235 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.237550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.237824 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.238488 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.240388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.266629 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1271/2534] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:22.270656 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.282125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c49561-48f7-49b0-bd32-fe3043f8a58e None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.310319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:22.344022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.344627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.344917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.345192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.345918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.347850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.369036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1264/2535] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:22.373065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.383821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414694-0154-46a8-b769-4896deb8cf49 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.388722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.389327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.389636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.389910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.390594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.392165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.403377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1272/2536] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:22.407283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.417936 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af665-e2a9-4057-ac43-ea185e2b7e04 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.422565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.423179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.423462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.423736 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.424427 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.426053 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb4305-9c22-4d44-867d-eede957a7a21 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.436025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1265/2537] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:22.440086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.450938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88b15b-c2e8-4737-8ef2-9aa521ca56e2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.455522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.456171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.456454 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.456729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] PATH_INFO: `/v3/projects/55ef34078836430ea1c86ac420d46945/users/89d9eaeebb7440aaa602c0f8ffd60859/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.471798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ef34078836430ea1c86ac420d46945, user_id=89d9eaeebb7440aaa602c0f8ffd60859, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.474514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.487391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1273/2538] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:22 2022] PUT /identity/v3/projects/55ef34078836430ea1c86ac420d46945/users/89d9eaeebb7440aaa602c0f8ffd60859/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:22.497593 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.497886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.498163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.526654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] MFA Rules not processed for user `89d9eaeebb7440aaa602c0f8ffd60859`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:22.527872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:22.590512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1266/2539] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:22.595262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.644664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:22.658596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011f629-fac2-4b12-97d8-8fa18a698794 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.663274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.663891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.664747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.665050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.665781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.667693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.694472 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1274/2540] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:22.698734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.709296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a65e0-aad3-4632-99fd-2c4c14382d80 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.764290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.764899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.765178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.765471 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.766133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.768044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.793489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1267/2541] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:22 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:22.797513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.809167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2fca-2d29-425d-82eb-3516b32d8401 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.814120 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.814744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.815026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.815302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.815990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.817651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.828730 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1275/2542] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:22.832989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.843497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0764-81ef-496f-b29b-8265e0bacf0b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.848066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.848681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.848957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.849227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] PATH_INFO: `/v3/projects/7456aa4af0d14553804d1e8da8f02601/users/06e08f3478524bb7b20ed2736a7a2dfc/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.864293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7456aa4af0d14553804d1e8da8f02601, user_id=06e08f3478524bb7b20ed2736a7a2dfc, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.867031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.880339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1268/2543] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:22 2022] PUT /identity/v3/projects/7456aa4af0d14553804d1e8da8f02601/users/06e08f3478524bb7b20ed2736a7a2dfc/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:22.884426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.894938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e07f1-88ee-42e7-9c80-a9ce1a6a7bff admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.952865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.953539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.953817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.954086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.954878 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.956478 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb0b01-4182-439f-bd47-02de5e41de17 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:22.966762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1276/2544] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:22.970944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:22.976372 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:22.982654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5493741-cdb2-43cf-b577-85ef468d632b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:22.987769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:22.988436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:22.988716 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:22.988991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] PATH_INFO: `/v3/projects/7456aa4af0d14553804d1e8da8f02601/users/06e08f3478524bb7b20ed2736a7a2dfc/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:22.991020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7456aa4af0d14553804d1e8da8f02601, user_id=06e08f3478524bb7b20ed2736a7a2dfc, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:22.994316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:23.004389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1269/2545] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:22 2022] PUT /identity/v3/projects/7456aa4af0d14553804d1e8da8f02601/users/06e08f3478524bb7b20ed2736a7a2dfc/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:23.015285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:23.015573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:23.015852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:23.043500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] MFA Rules not processed for user `06e08f3478524bb7b20ed2736a7a2dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:23.044689 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:23.129600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1277/2546] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:52:23.138382 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:23.140229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:23.217218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cb611-0761-4d6b-8bb2-1c08637fa341 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:23.221218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:23.221880 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:23.222164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:23.222440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:23.281060 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:23.282711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:23.296147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1270/2547] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:24.811494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:24.812903 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:24.826984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9cc36-8a06-459a-acc8-a52dde195bfa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:24.830760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:24.831392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:24.831705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:24.831979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:24.876453 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:24.898076 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:24.900906 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143966a5-3e45-47a5-a386-30da47f85a3a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:24.913744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1278/2548] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:25.448028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:25.456603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c6c2c-dac3-45cb-aef4-b64c91aa568c service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:25.460247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:25.460895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:25.461250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:25.461568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:25.470694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:25.472135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:25.482252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1271/2549] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:28.007143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:28.007683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:28.007925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:28.029868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:28.031112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:28.092596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1279/2550] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:28.106229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:28.107753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:28.179234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527bf2-81b6-43a0-ac8f-3a47bcc466df service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:28.185013 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:28.185669 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:28.185953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:28.186233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:28.199293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:28.200918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ced38-17e8-405f-8125-09d5ab894565 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:28.211939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1272/2551] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:52:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:29.393234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:29.459502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87bf7-c8d2-4b17-9003-af6b20163a97 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:29.464984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:29.465782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:29.466124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:29.466409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] PATH_INFO: `/v3/users/a7ea0cb4bb50496f9265b55b6c16cf47` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:29.467614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ea0cb4bb50496f9265b55b6c16cf47)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:29.469581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:29.521548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ea0cb4bb50496f9265b55b6c16cf47'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:29.522502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ea0cb4bb50496f9265b55b6c16cf47'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:29.531022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ea0cb4bb50496f9265b55b6c16cf47'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:29.539573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ea0cb4bb50496f9265b55b6c16cf47'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:29.540388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ea0cb4bb50496f9265b55b6c16cf47'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:29.558771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1280/2552] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:29 2022] DELETE /identity/v3/users/a7ea0cb4bb50496f9265b55b6c16cf47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:52:29.563165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:29.563659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:29.563791 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:29.582379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:29.583806 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:29.597154 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:29.645959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1273/2553] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:29.656307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:29.657777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:29.668770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:29.719814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5ecd9-12a5-4470-83c3-8661ca245d2a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:29.723657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:29.724365 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:29.724649 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:29.724927 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:29.735085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:29.737653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:29.746955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1281/2554] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:30.358632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:30.360173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:30.381078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c300ee-2e59-48b8-8dcb-3683c4c09a32 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:30.387375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:30.388159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:30.388514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:30.388790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] PATH_INFO: `/v3/projects/2476f933bbd74a9e84abc76549305e5b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:30.389975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2476f933bbd74a9e84abc76549305e5b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:30.391937 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:30.438313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2476f933bbd74a9e84abc76549305e5b', 'request_id': 'req-75e14265-84b5-4526-ae09-711c6ee411cf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.443877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2476f933bbd74a9e84abc76549305e5b', 'request_id': 'req-75e14265-84b5-4526-ae09-711c6ee411cf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.451608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2476f933bbd74a9e84abc76549305e5b', 'request_id': 'req-75e14265-84b5-4526-ae09-711c6ee411cf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.462449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] The token cache is being invalidate because project 2476f933bbd74a9e84abc76549305e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:30.462734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.463363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.464870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1274/2555] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:30 2022] DELETE /identity/v3/projects/2476f933bbd74a9e84abc76549305e5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:30.468800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:30.478469 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19d92-9d00-4c4b-b82f-3a5b9f4630b8 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:30.534125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:30.534759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:30.535043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:30.535320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] PATH_INFO: `/v3/users/89d9eaeebb7440aaa602c0f8ffd60859` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:30.536476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d9eaeebb7440aaa602c0f8ffd60859)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:30.538447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:30.584595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d9eaeebb7440aaa602c0f8ffd60859'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.585247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d9eaeebb7440aaa602c0f8ffd60859'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.592160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d9eaeebb7440aaa602c0f8ffd60859'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.599415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d9eaeebb7440aaa602c0f8ffd60859'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.600065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d9eaeebb7440aaa602c0f8ffd60859'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:30.619403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1282/2556] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:30 2022] DELETE /identity/v3/users/89d9eaeebb7440aaa602c0f8ffd60859 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:30.891271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:30.892931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:30.908453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14265-84b5-4526-ae09-711c6ee411cf admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:30.967919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:30.968859 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:30.969142 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:30.969453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] PATH_INFO: `/v3/projects/55ef34078836430ea1c86ac420d46945` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:30.970604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ef34078836430ea1c86ac420d46945)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:30.972516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.016591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:31.020179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ef34078836430ea1c86ac420d46945', 'request_id': 'req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.027190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ef34078836430ea1c86ac420d46945', 'request_id': 'req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.033954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ef34078836430ea1c86ac420d46945', 'request_id': 'req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.045980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] The token cache is being invalidate because project 55ef34078836430ea1c86ac420d46945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:31.046269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.046914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.048423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1275/2557] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:30 2022] DELETE /identity/v3/projects/55ef34078836430ea1c86ac420d46945 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:31.052549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.053991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:31.067405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4471c-e312-4a84-b15e-95e1c0ee0ca8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.093594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:31.126172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.126814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.127093 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.127368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] PATH_INFO: `/v3/users/06e08f3478524bb7b20ed2736a7a2dfc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.128557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e08f3478524bb7b20ed2736a7a2dfc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.130522 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.176949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e08f3478524bb7b20ed2736a7a2dfc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.177648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e08f3478524bb7b20ed2736a7a2dfc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.185039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e08f3478524bb7b20ed2736a7a2dfc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.192917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e08f3478524bb7b20ed2736a7a2dfc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.193664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f37f691f-a28a-4963-86c5-3869fa750ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e08f3478524bb7b20ed2736a7a2dfc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.212097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1283/2558] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:31 2022] DELETE /identity/v3/users/06e08f3478524bb7b20ed2736a7a2dfc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:31.478148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.479655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:31.493052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c85ec-6041-42a8-93a7-36cfdafaf0f8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.549440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.550077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.550352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.550623 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] PATH_INFO: `/v3/projects/7456aa4af0d14553804d1e8da8f02601` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.551748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7456aa4af0d14553804d1e8da8f02601)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.553673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.598544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7456aa4af0d14553804d1e8da8f02601', 'request_id': 'req-560bcde3-e865-4c6f-abaa-53096fdd0d4f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.604535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7456aa4af0d14553804d1e8da8f02601', 'request_id': 'req-560bcde3-e865-4c6f-abaa-53096fdd0d4f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.611617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7456aa4af0d14553804d1e8da8f02601', 'request_id': 'req-560bcde3-e865-4c6f-abaa-53096fdd0d4f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.625062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] The token cache is being invalidate because project 7456aa4af0d14553804d1e8da8f02601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:31.625360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.626111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-560bcde3-e865-4c6f-abaa-53096fdd0d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:31.627629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1276/2559] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:31 2022] DELETE /identity/v3/projects/7456aa4af0d14553804d1e8da8f02601 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:31.632674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.633135 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.633449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.652949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:31.654283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:31.715505 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1284/2560] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:52:31.723281 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.723598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.723871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.744045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:31.745183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:31.753160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1277/2561] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:31.757315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.767267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16006-b7dc-4adb-bac2-a7d4110618bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.771817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.772425 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.772707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.772984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.774202 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:52:31.774507 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.776095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.787441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1285/2562] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:52:31.792068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.801297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f3f66-534e-47ae-92cb-99234ece75b8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.806264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.806877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.807159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.807436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.808149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.810109 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.837465 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1278/2563] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:52:31 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:31.841677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.852263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a380f8-a521-4d3e-b785-ad2a11895e08 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.884174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:31.910447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.911068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.911350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.911627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.912293 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.914793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.935728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1286/2564] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:52:31 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:52:31.940502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.950822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c6a3-ca84-46d4-855a-ba6c56920de0 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.955411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.956032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.956300 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.956574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.957260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.958888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:31.969113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1279/2565] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:52:31.973031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:31.984144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae8bcf-9d3c-425b-a9f9-003325b59035 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:31.988915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:31.989582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:31.989867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:31.990180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:31.990862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:31.992612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f739-52b1-4a62-bd62-dbe03a4e86fc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:32.003163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1287/2566] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:52:32.007006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:32.017222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cb81a-87e1-4d54-a092-99b585f705a2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:32.021829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:32.022481 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:32.022760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:32.023553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] PATH_INFO: `/v3/projects/f4b7a885c05f4b1692335fbe6d86c682/users/0d3c76e815064552b1f21f2c3bf3b65c/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:32.038490 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b7a885c05f4b1692335fbe6d86c682, user_id=0d3c76e815064552b1f21f2c3bf3b65c, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:32.042009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:32.050380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:32.055428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1280/2567] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:52:32 2022] PUT /identity/v3/projects/f4b7a885c05f4b1692335fbe6d86c682/users/0d3c76e815064552b1f21f2c3bf3b65c/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:32.065600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:32.065887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:32.066161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:32.093624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] MFA Rules not processed for user `0d3c76e815064552b1f21f2c3bf3b65c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:32.094833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:32.160162 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1288/2568] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:32.171441 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:32.173116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:32.231000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfc2c-535a-4c14-991b-6e5674f6894e admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:32.234658 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:32.235278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:32.235580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:32.235913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:32.244638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:32.246115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3bc7-62a0-4134-ab30-b71ab0082b63 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:32.255691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1281/2569] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:34.798509 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:34.860266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c624-9310-4c4e-8cc0-40c804baf6cf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:34.864733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:34.865366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:34.865676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:34.865944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] PATH_INFO: `/v3/users/0d3c76e815064552b1f21f2c3bf3b65c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:34.867276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3c76e815064552b1f21f2c3bf3b65c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:34.869170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:34.914200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:34.915992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3c76e815064552b1f21f2c3bf3b65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:34.916944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3c76e815064552b1f21f2c3bf3b65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:34.925302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3c76e815064552b1f21f2c3bf3b65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:34.933385 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3c76e815064552b1f21f2c3bf3b65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:34.934069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3c76e815064552b1f21f2c3bf3b65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:34.952508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1289/2570] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:52:34 2022] DELETE /identity/v3/users/0d3c76e815064552b1f21f2c3bf3b65c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:34.956996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:34.957486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:34.957642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:34.976081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:52:34.977278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:35.035887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1282/2571] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:52:35.045769 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:35.047172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:35.105042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05960-237f-4fa0-a145-ae06890becff admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:35.108779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:35.109397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:35.109713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:35.109990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:35.119725 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:35.121160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:35.130563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1290/2572] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:52:35.395860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:52:35.397508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:52:35.424765 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584135ab-f1d1-4a4b-bac8-dbcba57663fd None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:52:35.429683 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:52:35.430338 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:52:35.430601 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:52:35.430941 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] PATH_INFO: `/v3/projects/f4b7a885c05f4b1692335fbe6d86c682` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:52:35.432025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b7a885c05f4b1692335fbe6d86c682)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:52:35.434064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:52:35.480565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b7a885c05f4b1692335fbe6d86c682', 'request_id': 'req-40a9609c-407d-4d89-a568-3b50a8a2fd1b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:35.486228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b7a885c05f4b1692335fbe6d86c682', 'request_id': 'req-40a9609c-407d-4d89-a568-3b50a8a2fd1b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:35.493904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b7a885c05f4b1692335fbe6d86c682', 'request_id': 'req-40a9609c-407d-4d89-a568-3b50a8a2fd1b'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:35.505330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] The token cache is being invalidate because project f4b7a885c05f4b1692335fbe6d86c682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:52:35.505649 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:35.506293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:52:35.508397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1283/2573] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:52:35 2022] DELETE /identity/v3/projects/f4b7a885c05f4b1692335fbe6d86c682 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:52:45.126345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:45.501870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:00.406861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:00.416435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2872-b38b-4444-9201-832710e6bf5f service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:00.464494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:00.465029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:00.465308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:00.465613 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:00.467345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:00.529072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:00.530526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:00.540677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1291/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:02.636368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:02.637887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:02.815950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9609c-407d-4d89-a568-3b50a8a2fd1b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:02.830738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:02.831444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:02.831729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:02.832000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:02.836084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:02.861563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:02.872547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:02.945141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1284/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:04.325797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:04.327277 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:04.397033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:04.398897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:04.418094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9ab9-ca7b-4fc5-9521-f938ea29bc5f service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:04.424868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:04.425802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:04.426732 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14a55-814a-4cd7-86a0-bc91c61de3cf service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:04.427258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:04.427547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] PATH_INFO: `/v3/users/1a343996462b462d86fb89b876f4e127` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:04.428972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a343996462b462d86fb89b876f4e127)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:04.431283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:04.438099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:04.438736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:04.439018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:04.439319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:04.441250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:04.456091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:04.458799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:04.477793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1292/2576] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:04.487503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a343996462b462d86fb89b876f4e127'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.488500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a343996462b462d86fb89b876f4e127'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.500752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a343996462b462d86fb89b876f4e127'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.501472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a343996462b462d86fb89b876f4e127'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.521948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cc791643-9673-4c9d-b712-4996763c0604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a343996462b462d86fb89b876f4e127'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.539671 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1285/2577] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:04 2022] DELETE /identity/v3/users/1a343996462b462d86fb89b876f4e127 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:04.735404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:04.752005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6c61-c6ad-4205-84cb-99dfef062903 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:04.807502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:04.831132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:04.831963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:04.832246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:04.832527 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] PATH_INFO: `/v3/projects/6a4b9969357142bc8724804eb47e0c48` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:04.833805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4b9969357142bc8724804eb47e0c48)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:04.836447 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:04.892091 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4b9969357142bc8724804eb47e0c48', 'request_id': 'req-31782424-d5ec-4032-9404-9d9a916de605'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.901888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4b9969357142bc8724804eb47e0c48', 'request_id': 'req-31782424-d5ec-4032-9404-9d9a916de605'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.909810 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4b9969357142bc8724804eb47e0c48', 'request_id': 'req-31782424-d5ec-4032-9404-9d9a916de605'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.925945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] The token cache is being invalidate because project 6a4b9969357142bc8724804eb47e0c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:04.926545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.928925 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-31782424-d5ec-4032-9404-9d9a916de605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:04.930910 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1293/2578] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:04 2022] DELETE /identity/v3/projects/6a4b9969357142bc8724804eb47e0c48 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:04.935997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:04.936287 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:04.936565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:04.961742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:04.963308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:05.016523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:05.032247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1286/2579] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:53:05.039935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.040224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.040536 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.062163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:05.063386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:05.072030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1294/2580] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:53:05.076356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.086296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65018022-2725-4d54-b9bc-39ec6be698ad None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.090895 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.091518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.091783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.092054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.092748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:53:05.093049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.094777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.107612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1287/2581] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:53:05.112081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.122356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec36056-297a-4ae0-90fe-190bf90f89c4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.127180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.127799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.128082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.128359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.129065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.131521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.164258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1295/2582] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:05 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:05.166271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.182019 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e283-1249-401b-98ae-deb3de303f4d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.249326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.250557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.250557 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.250819 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.251518 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.253553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.288442 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1288/2583] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:05 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:05.289820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.300665 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198a6a-3e2e-4e2e-bf9e-fc3ca57b9dee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.305913 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.306548 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.306834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.307113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.307821 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.309433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.323614 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1296/2584] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:05.325506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.336244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b566d-042d-477e-80fe-800c9e07488d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.341829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.342607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.342964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.343648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.344047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.345703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a252f3-2d23-4659-b456-e5e511b95fc0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.361016 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1289/2585] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:53:05.362851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.378101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9295b4-d10b-4d77-94a3-b38094b3cafb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.383516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.384427 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.384996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.385652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] PATH_INFO: `/v3/projects/a33ad5eb2d4849b5bf95011b7a17d562/users/8c14f0f1a729492f8fac45a794652166/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.404731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33ad5eb2d4849b5bf95011b7a17d562, user_id=8c14f0f1a729492f8fac45a794652166, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.407603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.424748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1297/2586] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:05 2022] PUT /identity/v3/projects/a33ad5eb2d4849b5bf95011b7a17d562/users/8c14f0f1a729492f8fac45a794652166/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:05.435150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.435710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.435710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.477891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] MFA Rules not processed for user `8c14f0f1a729492f8fac45a794652166`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:05.481688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:05.554650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1290/2587] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:05.565785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.567503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:05.638974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:05.650516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccd45-1d41-437d-8b83-1627fa0501d8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.657992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.659051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.659401 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.660057 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.673388 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.675050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd06f15-16d3-4f7c-9a3e-10084d248172 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:05.690323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1298/2588] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:05.904560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:05.957214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:05.969246 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1be27-1245-46db-8997-645fbbccfe81 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:05.973756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:05.974396 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:05.975189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:05.975655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] PATH_INFO: `/v3/users/8c14f0f1a729492f8fac45a794652166` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:05.976978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c14f0f1a729492f8fac45a794652166)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:05.978947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.024217 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c14f0f1a729492f8fac45a794652166'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.024790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c14f0f1a729492f8fac45a794652166'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.032337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c14f0f1a729492f8fac45a794652166'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.032962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c14f0f1a729492f8fac45a794652166'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.046337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c14f0f1a729492f8fac45a794652166'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.059400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1291/2589] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:05 2022] DELETE /identity/v3/users/8c14f0f1a729492f8fac45a794652166 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:06.064077 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.064386 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.064663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.083641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:06.085558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:06.143617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1299/2590] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:06.154073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.155476 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:06.213047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b955507-8ed7-43fc-9596-bbe5124bc4e3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.216667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.217283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.217600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.217873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.227335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.228774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012c9e1-870a-41fc-a3a4-156b5bf998a7 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.238239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1292/2591] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:06.512145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.513867 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:06.529706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b841e6-13b8-495b-9f27-f92bf3c4140e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.536378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.537118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.538232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.538744 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] PATH_INFO: `/v3/projects/a33ad5eb2d4849b5bf95011b7a17d562` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.540269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33ad5eb2d4849b5bf95011b7a17d562)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.544234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.594648 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33ad5eb2d4849b5bf95011b7a17d562', 'request_id': 'req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.601672 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33ad5eb2d4849b5bf95011b7a17d562', 'request_id': 'req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.607781 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33ad5eb2d4849b5bf95011b7a17d562', 'request_id': 'req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.621875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] The token cache is being invalidate because project a33ad5eb2d4849b5bf95011b7a17d562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:06.622154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.622799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eaed9c71-99ac-43a4-9f15-e3e1038c8fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:06.624337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1300/2592] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:06 2022] DELETE /identity/v3/projects/a33ad5eb2d4849b5bf95011b7a17d562 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:06.629630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.630179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.630363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.652178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:06.653811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:06.720191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1293/2593] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:53:06.729517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.729905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.730176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.754511 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:06.755764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:06.765119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1301/2594] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:06.769369 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.779695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5aaaf-a680-409a-b802-71a235297336 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.784413 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.785038 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.785322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.785638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.786337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:53:06.786642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.788303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.801469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1294/2595] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 11:53:06.806302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.817883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae448deb-74c4-46aa-aaa9-1bba7bfb5d2c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.823978 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.824766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.825133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.825526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.826315 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.828312 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.856993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1302/2596] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:06 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:06.861118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.866291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:06.872312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a0c0d-7601-4f33-9d9a-17d80bd57d9b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.931106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.931724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.932009 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.932292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.932954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.934902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.957273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1295/2597] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:06 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:06.962355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:06.972958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41f4e8-7408-488f-887f-c77a408bd1a8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:06.977663 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:06.978306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:06.978587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:06.978887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:06.979581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:06.981203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:06.991674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1303/2598] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:06.995710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.005665 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1d81-130b-400a-99dd-5935aede946d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.011067 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.011679 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.011963 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.012240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.012928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.014561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a593e-7825-4169-8e8f-875fa6029cff admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.025031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1296/2599] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:07.029099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.039152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920def5-c484-4d45-8724-515c6e9a76fd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.043764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.044414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.044697 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.044976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] PATH_INFO: `/v3/projects/f20e5df258264d2eaf27b2e166239472/users/da2b3b20aefd40749fb8bf06d82345b4/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.061529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20e5df258264d2eaf27b2e166239472, user_id=da2b3b20aefd40749fb8bf06d82345b4, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.064260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.077170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1304/2600] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:07 2022] PUT /identity/v3/projects/f20e5df258264d2eaf27b2e166239472/users/da2b3b20aefd40749fb8bf06d82345b4/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:07.087473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.087760 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.088036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.115884 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] MFA Rules not processed for user `da2b3b20aefd40749fb8bf06d82345b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:07.117014 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:07.181179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1297/2601] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:07.185656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.199161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:07.248344 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22c7b-6eb2-4283-a916-c86c633a4c8d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.252931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.253583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.253865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.254136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.254804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.257257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.283252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1305/2602] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:07 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:07.287628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.298305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35638-52a9-492d-8614-c431045bc730 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.353359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.353997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.354278 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.354554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.355247 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.357157 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.373552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:07.378827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1298/2603] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:07 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:07.382877 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.393156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a1001-2bc3-4471-a97f-d348d61f0147 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.398070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.398675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.398955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.399226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.399905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.401518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.411830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1306/2604] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:07.416754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.427005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16693cc-93c6-4585-89ba-dbed78d5b871 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.432521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.433191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.433503 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.433783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] PATH_INFO: `/v3/projects/0b68491ccffe4f5a8c061bfcd577549e/users/dbf2295764f246f9b3c915e64fbb35a2/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.448787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b68491ccffe4f5a8c061bfcd577549e, user_id=dbf2295764f246f9b3c915e64fbb35a2, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.451492 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.464251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1299/2605] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:07 2022] PUT /identity/v3/projects/0b68491ccffe4f5a8c061bfcd577549e/users/dbf2295764f246f9b3c915e64fbb35a2/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:07.468225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.478804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf50d5-ba1e-4ca2-bc20-d4b7c42d4bf3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.533898 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.534558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.534779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.535048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.535722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.537843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989378-1e41-4da8-a655-972743bc0ecf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.547521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1307/2606] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:53:07.551846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.562749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3cfdd-946f-4752-aab4-90ea4d70e7dd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.567359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.568021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.568303 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.568578 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] PATH_INFO: `/v3/projects/0b68491ccffe4f5a8c061bfcd577549e/users/dbf2295764f246f9b3c915e64fbb35a2/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.570580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b68491ccffe4f5a8c061bfcd577549e, user_id=dbf2295764f246f9b3c915e64fbb35a2, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.573218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.583374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1300/2607] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:07 2022] PUT /identity/v3/projects/0b68491ccffe4f5a8c061bfcd577549e/users/dbf2295764f246f9b3c915e64fbb35a2/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:07.593586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.593883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.594164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.622600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] MFA Rules not processed for user `dbf2295764f246f9b3c915e64fbb35a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:07.623866 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:07.700176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1308/2608] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:07.712214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.714023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:07.774123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c5ec7-f672-4e69-80a6-92b8aa357536 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.777919 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.778542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.778818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.779086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.788527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.789985 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8694c-e961-45c9-8f9b-73ed3182c879 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.799611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1301/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:07.888153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:07.899054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158feab2-06ce-46da-a666-ba3d36d0fdd7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:07.903125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:07.903779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:07.904069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:07.904529 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:07.909108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:07.981058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:07.982553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:07.992491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1309/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:14.082877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:14.083321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:14.089856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:14.105062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:14.106397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:14.189728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1302/2611] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:14.214463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:14.216095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:14.295126 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bc4c-8b4b-45e6-8776-5e27fa438e32 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:14.303761 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:14.304414 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:14.304690 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:14.304966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:14.324320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:14.326022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:14.336683 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1310/2612] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:53:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:17.284045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:17.285484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:17.359539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46beef-ba8c-4cc5-955e-84161e1aacb0 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:17.363405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:17.364043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:17.364323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:17.364591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:17.366855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:17.400274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:17.446353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:17.447814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:17.460893 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1303/2613] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:18.264526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:18.266739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:18.357067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7a51-c274-4fdc-8ba7-d6ca06993ce6 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:18.369332 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:18.370058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:18.370322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:18.370600 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:18.372546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:18.386272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:18.387981 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:18.398476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1311/2614] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:22.276299 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:22.277912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:22.296385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697cc3-f005-4624-9ec0-a5287aeddc12 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:22.302360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:22.303025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:22.303310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:22.303584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] PATH_INFO: `/v3/users/ee3506015d9240258cbada860704dffe` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:22.304801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3506015d9240258cbada860704dffe)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:22.306759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:22.368363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3506015d9240258cbada860704dffe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.369174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3506015d9240258cbada860704dffe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.379415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3506015d9240258cbada860704dffe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.380153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3506015d9240258cbada860704dffe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.397384 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-c6aff943-67b8-4db2-b431-1c115b628601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3506015d9240258cbada860704dffe'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.413538 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1304/2615] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:22 2022] DELETE /identity/v3/users/ee3506015d9240258cbada860704dffe => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:22.632583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:22.644333 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d781-9c9d-468f-a796-99653867c7e7 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:22.673390 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:22.720964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:22.721741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:22.722097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:22.722726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] PATH_INFO: `/v3/projects/90047b9130334326ad98280a8edb2bc6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:22.724811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90047b9130334326ad98280a8edb2bc6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:22.726863 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:22.789763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90047b9130334326ad98280a8edb2bc6', 'request_id': 'req-855e3529-88da-4aae-b55f-2641945ef405'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.809803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90047b9130334326ad98280a8edb2bc6', 'request_id': 'req-855e3529-88da-4aae-b55f-2641945ef405'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.819037 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90047b9130334326ad98280a8edb2bc6', 'request_id': 'req-855e3529-88da-4aae-b55f-2641945ef405'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.832262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] The token cache is being invalidate because project 90047b9130334326ad98280a8edb2bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:22.832554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.833185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:22.835327 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1312/2616] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:22 2022] DELETE /identity/v3/projects/90047b9130334326ad98280a8edb2bc6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:22.840295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac21b-79e3-4caa-b56c-5103c3f3da72 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:22.840588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac21b-79e3-4caa-b56c-5103c3f3da72 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:22.840861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac21b-79e3-4caa-b56c-5103c3f3da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:22.950345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:22.952271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:22.988692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-370ac21b-79e3-4caa-b56c-5103c3f3da72 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:22.990528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-370ac21b-79e3-4caa-b56c-5103c3f3da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.034666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e3529-88da-4aae-b55f-2641945ef405 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.039784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.040538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.041035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.041387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] PATH_INFO: `/v3/users/5c56880b1a64449e8e0de42174222600` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.042953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c56880b1a64449e8e0de42174222600)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.044684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.071868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1305/2617] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:23.076025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.076025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.076025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.096888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:23.098134 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.101845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c56880b1a64449e8e0de42174222600'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.102587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c56880b1a64449e8e0de42174222600'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.108052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1306/2618] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:23.110586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c56880b1a64449e8e0de42174222600'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.112666 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:23.113200 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.120553 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c56880b1a64449e8e0de42174222600'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.121328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c56880b1a64449e8e0de42174222600'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.132695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22f46-6943-45c4-97a0-633999c58d15 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.138190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.139401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.140080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.140793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.141807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:53:23.142290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.143248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1313/2619] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:22 2022] DELETE /identity/v3/users/5c56880b1a64449e8e0de42174222600 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:23.144916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.158130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1307/2620] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:53:23.164590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.166054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.256260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470be499-3d2d-4aae-a1cc-58da2b8c2a13 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.261760 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.262820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.262820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.263215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.263982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.266046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.301063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1314/2621] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:23 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:23.306866 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.319802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013f96-4049-4f9b-947d-5ece3b6a2be9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.331922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:23.379500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.383216 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.413984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.415535 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.415860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.416361 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.417628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.420315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.457470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1308/2622] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:23 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:23.462672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.479159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5fdc-dd62-4ac6-beff-0e0103be5479 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.485918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.486831 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.487744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.488353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.490164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.492095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.499044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd267a-204f-4468-9d69-b1e0ce6a4fb0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.507498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.507498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.507498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.507498 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] PATH_INFO: `/v3/projects/861c5a0403c94abd9ae479175604c835` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.507946 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=861c5a0403c94abd9ae479175604c835)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.508568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1309/2623] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:23.509498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.510048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.519821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c00b-177a-483e-a1fa-9b16a7a221ab admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.525054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.525725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.526006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.526296 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.527005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.528664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.540258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1310/2624] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:23.544504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.556252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e423-4fad-4a03-9948-10cb6eadef7d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.565345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861c5a0403c94abd9ae479175604c835', 'request_id': 'req-ebea7919-53df-405b-bc52-4e8a8960df6b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.572284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861c5a0403c94abd9ae479175604c835', 'request_id': 'req-ebea7919-53df-405b-bc52-4e8a8960df6b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.577815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:23.580534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861c5a0403c94abd9ae479175604c835', 'request_id': 'req-ebea7919-53df-405b-bc52-4e8a8960df6b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.595868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] The token cache is being invalidate because project 861c5a0403c94abd9ae479175604c835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:23.596152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.596786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.598342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1315/2625] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:23 2022] DELETE /identity/v3/projects/861c5a0403c94abd9ae479175604c835 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:23.602792 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.604288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.621952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.622711 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.622988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.623292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] PATH_INFO: `/v3/projects/69ac15e2b1074938adfa7615f1ff1495/users/20da01b3f86d40cfa84762492eea43f1/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.638295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ac15e2b1074938adfa7615f1ff1495, user_id=20da01b3f86d40cfa84762492eea43f1, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.640902 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99d5c-2196-4d9e-9d62-76f41006a7ba admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.655631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1311/2626] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:23 2022] PUT /identity/v3/projects/69ac15e2b1074938adfa7615f1ff1495/users/20da01b3f86d40cfa84762492eea43f1/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:23.660290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.660521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.660803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.673399 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7919-53df-405b-bc52-4e8a8960df6b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.681976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:23.683185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.757457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1312/2627] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:53:23.759278 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.760200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.760551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.760891 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] PATH_INFO: `/v3/users/f4e70089c2e0491d9a5acaa31d79b3c5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.762192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e70089c2e0491d9a5acaa31d79b3c5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.764217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.768755 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:23.770363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.780411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:23.820819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e70089c2e0491d9a5acaa31d79b3c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.821682 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e70089c2e0491d9a5acaa31d79b3c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.828721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e70089c2e0491d9a5acaa31d79b3c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.834256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bde79-c664-4abc-bade-d6d2677df52b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:23.838183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:23.838438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e70089c2e0491d9a5acaa31d79b3c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.838879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:23.839088 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:23.839207 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e70089c2e0491d9a5acaa31d79b3c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:23.839377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:23.841177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:23.853882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:23.855215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a68159-4165-49dd-9d85-45462d052bed service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:23.858598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1316/2628] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:23 2022] DELETE /identity/v3/users/f4e70089c2e0491d9a5acaa31d79b3c5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:53:23.865550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1313/2629] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:53:24.082125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.084089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:24.105058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:24.158933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c784c-b8de-4a8e-9414-cf1297b5bbcb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.164756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.165409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.165729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.166007 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] PATH_INFO: `/v3/projects/e416fabf8136411489d3964dd2af2249` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.167186 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e416fabf8136411489d3964dd2af2249)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.169101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.232748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e416fabf8136411489d3964dd2af2249', 'request_id': 'req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:24.239292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e416fabf8136411489d3964dd2af2249', 'request_id': 'req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:24.248002 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e416fabf8136411489d3964dd2af2249', 'request_id': 'req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:24.263298 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] The token cache is being invalidate because project e416fabf8136411489d3964dd2af2249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:24.263518 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:24.264770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-189fba9e-a3f0-403e-bc40-5ffbbec8f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:24.269185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1317/2630] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:24 2022] DELETE /identity/v3/projects/e416fabf8136411489d3964dd2af2249 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:24.271276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.271621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.271906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.301314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:24.303244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:24.377097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1314/2631] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:53:24.386380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.387342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.387342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.408459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:24.409936 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:24.418599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1318/2632] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:24.422952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.434840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a23d-e4e0-4b35-826b-19ac67d78745 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.439405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.440022 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.440295 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.440626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.441322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:53:24.441648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.443938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.455627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1315/2633] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:53:24.461500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.470749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a99f-4d15-4ea9-b4b5-5d1ed9e41eda None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.476407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.477134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.477449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.477731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.478411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.480407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.511642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1319/2634] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:24.513293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.535012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470887-a4b2-4c36-b853-c9970bc794de admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.611405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.611405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.611405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.611405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.611829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.613820 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.643588 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1316/2635] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:24 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:24.648729 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.663023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8bb44-2706-4c41-a230-1d03827639f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.668714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.669598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.670063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.670487 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.671338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.673104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.699984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1320/2636] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:24.703796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.717830 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021735bb-9a20-46f3-a053-9c13008255a5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.724350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.725017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.725301 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.726138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.726996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.729046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1a977-9285-4a0f-94d3-0b02ae9273fe admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.746575 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1317/2637] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:24.751081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.763800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac21f-4f07-485c-823b-8247da4a3451 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:24.769046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:24.769756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.770041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.770321 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] PATH_INFO: `/v3/projects/8fd8c34715e54a778911a8410e095800/users/2a98ee7a5076425aa7cf6cb2107da67f/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.790019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd8c34715e54a778911a8410e095800, user_id=2a98ee7a5076425aa7cf6cb2107da67f, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:24.796430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:24.816115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1321/2638] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:24 2022] PUT /identity/v3/projects/8fd8c34715e54a778911a8410e095800/users/2a98ee7a5076425aa7cf6cb2107da67f/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:24.818982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860073-038d-41a1-a2fc-4d3f9bffde16 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:24.819394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860073-038d-41a1-a2fc-4d3f9bffde16 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:24.819729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860073-038d-41a1-a2fc-4d3f9bffde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:24.841096 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-51860073-038d-41a1-a2fc-4d3f9bffde16 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:24.843076 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-51860073-038d-41a1-a2fc-4d3f9bffde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:24.852769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:24.920766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1318/2639] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:24.927515 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:24.929283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:24.986519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:25.001582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d8e9-23fa-4999-b0f3-9c5f6d8c2ce7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:25.006874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:25.007736 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:25.008118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:25.008458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:25.018930 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:25.020467 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:25.032255 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1322/2640] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:30.478694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6416-bf94-4b93-b789-fb54d47c0ead None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:30.478694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6416-bf94-4b93-b789-fb54d47c0ead None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:30.478694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6416-bf94-4b93-b789-fb54d47c0ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:30.511763 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-25ce6416-bf94-4b93-b789-fb54d47c0ead None None] MFA Rules not processed for user `20da01b3f86d40cfa84762492eea43f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:30.513015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-25ce6416-bf94-4b93-b789-fb54d47c0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:30.598249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1319/2641] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:30.613060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:30.614693 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:30.871387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cc2a-80ec-457b-999c-491e0dd8d07e service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:30.878022 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:30.893464 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:30.894908 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:30.896652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:30.921584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:30.924748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:30.947969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1323/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:32.272960 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.273409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.273529 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.314241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] MFA Rules not processed for user `2a98ee7a5076425aa7cf6cb2107da67f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:32.319326 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:32.402480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1320/2643] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:32.407165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.431720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8255da-3b45-4056-b275-6bc58b1bb980 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.437979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.438616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.439900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.440367 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.441813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.444543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.503501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1324/2644] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:32 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:32.505903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.522059 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3c831-8c55-4f00-9e91-2ae0f653ebae None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.563757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:32.620452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.621095 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.621640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.621918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.622647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.624655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.665400 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.667710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1321/2645] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:32 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:32.680155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92e05-eb90-4a7d-a547-833f57590dcb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.698439 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.699118 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.699408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.699807 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.701012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.702847 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224babf-bc2e-457f-b14e-56229da51b4f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.722904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1325/2646] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:32.723018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.727935 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.728294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.728784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.731114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599306db-9211-44a0-ac27-7f82db0e2f5f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.736260 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.737827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.738131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.738412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] PATH_INFO: `/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7/users/6c3c61baefc34aa4a5f5fdfdef146540/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.750122 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] MFA Rules not processed for user `20da01b3f86d40cfa84762492eea43f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:32.751484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:32.757595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfbf5e35faf453b8267534f53d0d5f7, user_id=6c3c61baefc34aa4a5f5fdfdef146540, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.766282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.790330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1322/2647] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:32 2022] PUT /identity/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7/users/6c3c61baefc34aa4a5f5fdfdef146540/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:32.794244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.857832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1326/2648] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:32.886387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd8e9-b039-4bfd-8efa-6054ca064a0b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.894292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.894980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.895269 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.895710 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.896423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.898242 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7a38c-4204-4cc2-9234-c24d1e21e058 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.911940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1323/2649] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:32.916739 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:32.933793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b05d-9279-4854-a351-92db83d60d40 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:32.961440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:32.962418 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:32.962943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:32.963389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] PATH_INFO: `/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7/users/6c3c61baefc34aa4a5f5fdfdef146540/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:32.966212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfbf5e35faf453b8267534f53d0d5f7, user_id=6c3c61baefc34aa4a5f5fdfdef146540, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:32.971038 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:32.988050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1327/2650] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:32 2022] PUT /identity/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7/users/6c3c61baefc34aa4a5f5fdfdef146540/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:39.343779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb27c3-7494-43e5-9df9-c87e1083318e None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:39.344637 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb27c3-7494-43e5-9df9-c87e1083318e None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:39.344962 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb27c3-7494-43e5-9df9-c87e1083318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:39.378188 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-45eb27c3-7494-43e5-9df9-c87e1083318e None None] MFA Rules not processed for user `6c3c61baefc34aa4a5f5fdfdef146540`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:39.379745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-45eb27c3-7494-43e5-9df9-c87e1083318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:39.460636 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1324/2651] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:39.475141 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:39.508461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:39.551581 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7144e0-b8b8-40a4-ab58-c935a46d3ce4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:39.559200 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:39.560861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:39.561194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:39.562026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:39.625016 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:39.626765 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:39.636751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1328/2652] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:53:41.175335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63210a-d1fc-476b-b013-7406f8af3c59 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:41.176162 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63210a-d1fc-476b-b013-7406f8af3c59 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:41.177488 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63210a-d1fc-476b-b013-7406f8af3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:41.198502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-bf63210a-d1fc-476b-b013-7406f8af3c59 None None] MFA Rules not processed for user `2a98ee7a5076425aa7cf6cb2107da67f`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:41.199876 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bf63210a-d1fc-476b-b013-7406f8af3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:41.207137 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1325/2653] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:49.042155 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:49.043658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:49.109043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bce67-f522-4f53-b4b8-37ce63b2dbd6 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:49.114679 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:49.115356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:49.115639 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:49.115918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] PATH_INFO: `/v3/users/da2b3b20aefd40749fb8bf06d82345b4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:49.117111 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2b3b20aefd40749fb8bf06d82345b4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:49.119084 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:49.168516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2b3b20aefd40749fb8bf06d82345b4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.169172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2b3b20aefd40749fb8bf06d82345b4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.176052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2b3b20aefd40749fb8bf06d82345b4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.184397 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2b3b20aefd40749fb8bf06d82345b4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.185058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2b3b20aefd40749fb8bf06d82345b4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.194808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:49.210874 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1329/2654] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:49 2022] DELETE /identity/v3/users/da2b3b20aefd40749fb8bf06d82345b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:49.215337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:49.215774 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:49.215868 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:49.234904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:49.236082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:49.244559 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:49.299092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1326/2655] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:49.309516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:49.310922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:49.370095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206a22e-750b-4149-af4c-13ae929d5dbb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:49.373622 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:49.374244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:49.374520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:49.374788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:49.383887 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:49.385681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:49.395533 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1330/2656] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:49.672690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:49.674238 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:49.686971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb38c6-5992-401e-830e-1bbf5d1b70d2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:49.692062 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:49.692693 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:49.692964 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:49.693235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] PATH_INFO: `/v3/projects/f20e5df258264d2eaf27b2e166239472` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:49.694434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20e5df258264d2eaf27b2e166239472)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:49.696354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:49.745253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20e5df258264d2eaf27b2e166239472', 'request_id': 'req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.750848 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20e5df258264d2eaf27b2e166239472', 'request_id': 'req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.764206 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20e5df258264d2eaf27b2e166239472', 'request_id': 'req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.777041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] The token cache is being invalidate because project f20e5df258264d2eaf27b2e166239472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:49.777477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.778149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.779798 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1327/2657] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:49 2022] DELETE /identity/v3/projects/f20e5df258264d2eaf27b2e166239472 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:49.783764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:49.798205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac1668-0498-4431-a03b-fe1ea7f06049 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:49.862362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:49.863113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:49.864049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:49.864477 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] PATH_INFO: `/v3/users/dbf2295764f246f9b3c915e64fbb35a2` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:49.865912 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf2295764f246f9b3c915e64fbb35a2)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:49.868013 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:49.925156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf2295764f246f9b3c915e64fbb35a2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.925852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf2295764f246f9b3c915e64fbb35a2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.942440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf2295764f246f9b3c915e64fbb35a2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.944970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf2295764f246f9b3c915e64fbb35a2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.944970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a364403c-4cd7-46b5-8569-5f635feccc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf2295764f246f9b3c915e64fbb35a2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:49.963285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1331/2658] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:53:49 2022] DELETE /identity/v3/users/dbf2295764f246f9b3c915e64fbb35a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:50.257817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.259258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:50.272997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754e88-96b6-4ca6-9c9d-925bcfac69b7 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.335986 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.336634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.336909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.337179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] PATH_INFO: `/v3/projects/0b68491ccffe4f5a8c061bfcd577549e` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.338350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b68491ccffe4f5a8c061bfcd577549e)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.340234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.385890 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:50.393772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b68491ccffe4f5a8c061bfcd577549e', 'request_id': 'req-e58055c8-7a53-403d-a913-a97795afb4d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:50.399743 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b68491ccffe4f5a8c061bfcd577549e', 'request_id': 'req-e58055c8-7a53-403d-a913-a97795afb4d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:50.407968 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b68491ccffe4f5a8c061bfcd577549e', 'request_id': 'req-e58055c8-7a53-403d-a913-a97795afb4d0'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:50.420388 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] The token cache is being invalidate because project 0b68491ccffe4f5a8c061bfcd577549e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:53:50.420676 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:50.421332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-e58055c8-7a53-403d-a913-a97795afb4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:53:50.422920 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1328/2659] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:53:50 2022] DELETE /identity/v3/projects/0b68491ccffe4f5a8c061bfcd577549e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:50.428554 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.429030 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.429127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.443985 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:50.450643 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:50.452417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:50.513894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1332/2660] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:50.522951 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.523239 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.523544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.543931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:50.545132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:50.553229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1329/2661] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:50.557777 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.567562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86e7a-c0c8-4a0a-966d-270659e455a9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.572043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.572656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.572933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.573199 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.573923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:53:50.574225 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.575798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.587480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1333/2662] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:53:50.591918 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.603094 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2f10f-4d0d-4ceb-8ae6-75bc13013aa4 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.607787 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.608399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.608674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.608939 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.609624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.611530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.639054 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1330/2663] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:50.643226 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.654116 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13baa4c-1745-4a1d-980c-9ce093a1f7ad admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.713405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.714059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.714355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.714607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.715295 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.717210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.738916 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1334/2664] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:53:50.743111 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.753782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec56e8-2d14-4f2b-b406-7e463124a5d9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.758949 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.759852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.760131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.760403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.761101 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.762747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.773633 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1331/2665] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:53:50.777809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.788755 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b99a1-82ef-4da4-b41f-eb58b5bc95d2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.793943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.794582 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.794858 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.795127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.795816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.797402 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03a5cc-a10d-4272-95e7-ca9c870b5019 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.808598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1335/2666] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:53:50.812879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:50.822950 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b364f1-afa6-4fc2-a3a7-1c0b13c18106 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:50.827552 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:50.828198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.828470 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.828739 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] PATH_INFO: `/v3/projects/85b4398ec8d3420c98c96f3c63564d8a/users/c87a642f0a434dc0afa13baeaa5f5611/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.844670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b4398ec8d3420c98c96f3c63564d8a, user_id=c87a642f0a434dc0afa13baeaa5f5611, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:50.847325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:50.860092 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1332/2667] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:50 2022] PUT /identity/v3/projects/85b4398ec8d3420c98c96f3c63564d8a/users/c87a642f0a434dc0afa13baeaa5f5611/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:50.871368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:50.871662 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:50.871940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:50.901151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] MFA Rules not processed for user `c87a642f0a434dc0afa13baeaa5f5611`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:50.902405 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:50.966933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1336/2668] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:50.971346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.041267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c928-2bff-4fef-944b-9c20a048ea6d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.046080 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.046698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.047003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.047276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.047946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.050008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.083997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1333/2669] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:53:50 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:51.085181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.090766 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:51.097862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef27d9-0115-4ca4-9565-e665fe73a312 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.160560 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.161228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.161539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.161815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.162482 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.164410 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.200134 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1337/2670] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:53:51 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:53:51.201324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.212385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa89b4-e925-42e1-8972-71da4dfd6bed admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.218192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.218747 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.219026 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.219298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.220105 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.222028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.239886 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1334/2671] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:51.244119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.256036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12114a77-a934-4652-ab7c-292255ca08a2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.260931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.261571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.261856 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.262189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] PATH_INFO: `/v3/projects/62a545217cf14209b404eda6a47cfac9/users/3dcc0b6eaaaa4e86bef0ce7edeec0575/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.287456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a545217cf14209b404eda6a47cfac9, user_id=3dcc0b6eaaaa4e86bef0ce7edeec0575, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.290267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.304845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1338/2672] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:51 2022] PUT /identity/v3/projects/62a545217cf14209b404eda6a47cfac9/users/3dcc0b6eaaaa4e86bef0ce7edeec0575/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:51.309077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.320168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1bc2d-b3bf-4474-b9c7-b4d9eb8a22e1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.357585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:51.383773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.384861 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.385168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.385494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.386189 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.387839 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967607c-4d6b-495b-ae36-71761a5aa269 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.402761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1335/2673] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:53:51.403880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.414771 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70525ec-e0f2-4b3c-b146-51ad367a751c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.419461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.420128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.420411 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.420684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] PATH_INFO: `/v3/projects/62a545217cf14209b404eda6a47cfac9/users/3dcc0b6eaaaa4e86bef0ce7edeec0575/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.422727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a545217cf14209b404eda6a47cfac9, user_id=3dcc0b6eaaaa4e86bef0ce7edeec0575, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.425728 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.437843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1339/2674] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:53:51 2022] PUT /identity/v3/projects/62a545217cf14209b404eda6a47cfac9/users/3dcc0b6eaaaa4e86bef0ce7edeec0575/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:53:51.449466 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.449753 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.450028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.481031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] MFA Rules not processed for user `3dcc0b6eaaaa4e86bef0ce7edeec0575`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:53:51.482204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:51.556828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1336/2675] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:53:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:53:51.569851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.571623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:53:51.635212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c7249-3a30-4c3e-9482-2c6059ec917a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.639526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.640373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.640837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.641302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.651508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.652947 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.664391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1340/2676] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:53:51.745500 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:53:51.755849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca4b19-ad7a-4d51-ac74-f0ee23985fc2 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:53:51.759645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:53:51.760263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:53:51.760542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:53:51.760814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:53:51.821511 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:53:51.822948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:53:51.832558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1337/2677] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:53:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:00.052635 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:00.054082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:00.109833 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a142349-ea32-4355-8a3c-48183e3a6b59 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:00.113376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:00.114036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:00.114328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:00.114596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:00.116360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:00.125656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:00.127059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e282622-04e8-4578-b308-7dbaf4ffa831 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:00.131587 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:00.136029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1341/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:01.821793 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:01.884121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=100 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:01.889349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de665bee-6e7d-4977-9635-3b84e843b7c3 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:01.895453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:01.896110 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:01.896402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:01.896661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] PATH_INFO: `/v3/users/c87a642f0a434dc0afa13baeaa5f5611` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:01.897883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87a642f0a434dc0afa13baeaa5f5611)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:01.899810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:01.951411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87a642f0a434dc0afa13baeaa5f5611'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:01.952141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87a642f0a434dc0afa13baeaa5f5611'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:01.966519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87a642f0a434dc0afa13baeaa5f5611'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:01.967282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87a642f0a434dc0afa13baeaa5f5611'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:01.986020 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87a642f0a434dc0afa13baeaa5f5611'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.001250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1338/2679] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:01 2022] DELETE /identity/v3/users/c87a642f0a434dc0afa13baeaa5f5611 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:02.006854 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:02.007323 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:02.007407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:02.029098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:02.030825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:02.103432 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1342/2680] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:02.110366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:02.112523 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:02.175032 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ecade-f946-4452-91a7-0b8dd2bc0de5 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:02.179610 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:02.180228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:02.180521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:02.180786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:02.190867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:02.192720 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:02.203380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1339/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:02.671642 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:02.673176 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:02.685538 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aa1bb-f283-4f09-a88c-3e12cadbc9bc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:02.691042 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:02.691795 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:02.692305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:02.693217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] PATH_INFO: `/v3/projects/85b4398ec8d3420c98c96f3c63564d8a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:02.695203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b4398ec8d3420c98c96f3c63564d8a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:02.697993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:02.749194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b4398ec8d3420c98c96f3c63564d8a', 'request_id': 'req-a3e0b41f-13da-485c-814c-9e6f919058c6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.756009 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b4398ec8d3420c98c96f3c63564d8a', 'request_id': 'req-a3e0b41f-13da-485c-814c-9e6f919058c6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.762434 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b4398ec8d3420c98c96f3c63564d8a', 'request_id': 'req-a3e0b41f-13da-485c-814c-9e6f919058c6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.775829 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] The token cache is being invalidate because project 85b4398ec8d3420c98c96f3c63564d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:02.776123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.776743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.778308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1343/2682] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:02 2022] DELETE /identity/v3/projects/85b4398ec8d3420c98c96f3c63564d8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:02.782333 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:02.792138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7080-5179-4e13-a813-8783cd551af5 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:02.859958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:02.860611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:02.860929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:02.861211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] PATH_INFO: `/v3/users/3dcc0b6eaaaa4e86bef0ce7edeec0575` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:02.862474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcc0b6eaaaa4e86bef0ce7edeec0575)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:02.865184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:02.919135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:02.963648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcc0b6eaaaa4e86bef0ce7edeec0575'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.964519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcc0b6eaaaa4e86bef0ce7edeec0575'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.982784 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcc0b6eaaaa4e86bef0ce7edeec0575'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:02.983486 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcc0b6eaaaa4e86bef0ce7edeec0575'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.001367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-cadf001c-763c-404d-b17d-ea348da8d9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcc0b6eaaaa4e86bef0ce7edeec0575'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.031359 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1340/2683] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:02 2022] DELETE /identity/v3/users/3dcc0b6eaaaa4e86bef0ce7edeec0575 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:54:03.366624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.368283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:03.392262 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b41f-13da-485c-814c-9e6f919058c6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.462616 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.463264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.463543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.463818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] PATH_INFO: `/v3/projects/62a545217cf14209b404eda6a47cfac9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.464969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a545217cf14209b404eda6a47cfac9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.466953 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.499306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:03.519782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a545217cf14209b404eda6a47cfac9', 'request_id': 'req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.527603 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a545217cf14209b404eda6a47cfac9', 'request_id': 'req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.533551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a545217cf14209b404eda6a47cfac9', 'request_id': 'req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.548095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] The token cache is being invalidate because project 62a545217cf14209b404eda6a47cfac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:03.548389 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.549153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-76e35e74-5d2f-4a2b-ae95-cec10fe1508b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:03.552206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1344/2684] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:03 2022] DELETE /identity/v3/projects/62a545217cf14209b404eda6a47cfac9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:03.558028 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.558344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.558627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.579754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:03.580990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:03.645008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1341/2685] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:03.653329 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.653657 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.653937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.678208 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:03.679440 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:03.687966 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1345/2686] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:03.693873 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.703677 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93679c-77b6-4fcf-83cb-b3c726b31864 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.708840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.709604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.709881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.710148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.710840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:54:03.711139 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.712817 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.728567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1342/2687] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:54:03.729688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.738884 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f787-fb68-4590-83c4-9234dcd48822 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.743625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.744236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.744517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.744793 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.745495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.747407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.779260 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1346/2688] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:54:03 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:54:03.780875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.791517 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb26f61-467c-49d8-a54c-1fcb61ed1264 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.849616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.850267 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.850547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.850821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.851484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.853439 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.874616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1343/2689] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:54:03 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:03.879222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.890059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f2f3-1e9c-4a1a-a97e-87306106af60 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.894618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.895271 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.895631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.895986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.896691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.898310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.908074 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1347/2690] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:03.912567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.922477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31d82b-568c-42dd-8922-588e791dfb9c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.927642 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.928276 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.928556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.928828 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.929544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.931135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a2afb-5f22-4c57-85aa-a424f6702bf6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.941827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1344/2691] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:03.945872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:03.956012 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019ea59-c9ac-4ecf-b756-b9e1601076b9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:03.961275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:03.961963 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:03.962246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:03.962520 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] PATH_INFO: `/v3/projects/7320673ef33b4c5f9ddd1133385dfa1b/users/e1a1b7b14d574c53bcf143b6e1060a60/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:03.977627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7320673ef33b4c5f9ddd1133385dfa1b, user_id=e1a1b7b14d574c53bcf143b6e1060a60, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:03.980194 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:03.992784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1348/2692] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:03 2022] PUT /identity/v3/projects/7320673ef33b4c5f9ddd1133385dfa1b/users/e1a1b7b14d574c53bcf143b6e1060a60/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:04.004050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.004339 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.004662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.013249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:04.036969 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] MFA Rules not processed for user `e1a1b7b14d574c53bcf143b6e1060a60`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:04.038379 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:04.113449 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1345/2693] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:04.118048 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.196816 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c7d0-35ae-4b4e-9cf2-cecd1015e97e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.201780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.202656 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.203158 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.203512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.204311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.210544 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.237817 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1349/2694] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:54:04 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:04.241879 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.252925 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fac3e-8703-49b6-a1b3-26713ff26630 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.311403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.312021 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.312297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.312564 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.313215 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.315153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.338639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1346/2695] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:54:04 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:04.342289 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.353669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5083-b9f0-4c02-b4bb-94379e9ef5b0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.358299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.358944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.359222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.359502 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.360190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.362059 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.373106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1350/2696] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:54:04.377468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.388315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2ca8f-7340-4add-9b02-83b7abc7143b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.393033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.393775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.394065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.394342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] PATH_INFO: `/v3/projects/2c2e28edcd37435e8363797644acc6be/users/ae10217cc1ec437f8c7bf84b44a97898/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.410583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2e28edcd37435e8363797644acc6be, user_id=ae10217cc1ec437f8c7bf84b44a97898, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.413400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.428128 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1347/2697] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:04 2022] PUT /identity/v3/projects/2c2e28edcd37435e8363797644acc6be/users/ae10217cc1ec437f8c7bf84b44a97898/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:04.432152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.442819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d839b8-5bf7-436f-a326-ab620dda3a8f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.463806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:04.503445 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.503992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.504426 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.505308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.506005 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.507588 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6e7d-7f02-4b21-a937-ab081deb9965 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.517837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1351/2698] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:04.522568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.540356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c303e0-8097-42d3-9537-971838e57379 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.545364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.546106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.546389 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.546666 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] PATH_INFO: `/v3/projects/2c2e28edcd37435e8363797644acc6be/users/ae10217cc1ec437f8c7bf84b44a97898/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.548647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2e28edcd37435e8363797644acc6be, user_id=ae10217cc1ec437f8c7bf84b44a97898, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.551335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.562072 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1348/2699] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:04 2022] PUT /identity/v3/projects/2c2e28edcd37435e8363797644acc6be/users/ae10217cc1ec437f8c7bf84b44a97898/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:04.572706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.572998 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.573279 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.600893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] MFA Rules not processed for user `ae10217cc1ec437f8c7bf84b44a97898`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:04.602137 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:04.670652 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1352/2700] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:04.682509 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:04.684250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:04.735342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:04.741108 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22a9-a950-4836-84ee-20d1cd0d5013 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:04.745544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:04.746156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:04.746436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:04.746708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:04.756378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:04.757822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d63b45-d198-43a9-9755-ddc55355c051 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:04.767261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1349/2701] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:54:06.103409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:06.164341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980fec-1c50-4a31-92ba-539008328065 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:06.168845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:06.169519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:06.169800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:06.170072 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] PATH_INFO: `/v3/users/e1a1b7b14d574c53bcf143b6e1060a60` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:06.171218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a1b7b14d574c53bcf143b6e1060a60)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:06.173106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:06.219596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a1b7b14d574c53bcf143b6e1060a60'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.220241 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a1b7b14d574c53bcf143b6e1060a60'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.221471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:06.228918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a1b7b14d574c53bcf143b6e1060a60'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.236067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a1b7b14d574c53bcf143b6e1060a60'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.236680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a1b7b14d574c53bcf143b6e1060a60'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.255678 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1353/2702] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:06 2022] DELETE /identity/v3/users/e1a1b7b14d574c53bcf143b6e1060a60 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:06.260408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:06.260878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:06.260973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:06.279411 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:06.280530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:06.337112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1350/2703] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:06.346923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:06.348359 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:06.404800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f3ec-809e-4f1c-904f-989f84b56d9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:06.408695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:06.409324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:06.409660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:06.409921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:06.419670 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:06.421090 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:06.431419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1354/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:06.706568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:06.708618 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:06.720374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316dcd-ca4b-4d4a-9261-4e996cb40ae8 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:06.725273 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:06.725954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:06.726240 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:06.726514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] PATH_INFO: `/v3/projects/7320673ef33b4c5f9ddd1133385dfa1b` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:06.727707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7320673ef33b4c5f9ddd1133385dfa1b)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:06.729659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:06.778237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7320673ef33b4c5f9ddd1133385dfa1b', 'request_id': 'req-ddb4abc9-f42b-4214-8e23-44266e072853'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.783691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7320673ef33b4c5f9ddd1133385dfa1b', 'request_id': 'req-ddb4abc9-f42b-4214-8e23-44266e072853'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.791420 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7320673ef33b4c5f9ddd1133385dfa1b', 'request_id': 'req-ddb4abc9-f42b-4214-8e23-44266e072853'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.802472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] The token cache is being invalidate because project 7320673ef33b4c5f9ddd1133385dfa1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:06.802694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.803321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.804842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1351/2705] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:06 2022] DELETE /identity/v3/projects/7320673ef33b4c5f9ddd1133385dfa1b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:06.808834 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:06.819596 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760bc07-ca3f-4db6-a02f-982a70ac5f55 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:06.875474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:06.876114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:06.876395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:06.876676 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] PATH_INFO: `/v3/users/ae10217cc1ec437f8c7bf84b44a97898` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:06.877864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae10217cc1ec437f8c7bf84b44a97898)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:06.880408 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:06.924924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae10217cc1ec437f8c7bf84b44a97898'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.925607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae10217cc1ec437f8c7bf84b44a97898'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.933032 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae10217cc1ec437f8c7bf84b44a97898'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.940785 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae10217cc1ec437f8c7bf84b44a97898'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.941374 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ee972620-a1d3-4e72-ae73-685c0b4e1f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae10217cc1ec437f8c7bf84b44a97898'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:06.947621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:06.964080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1355/2706] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:06 2022] DELETE /identity/v3/users/ae10217cc1ec437f8c7bf84b44a97898 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:07.243127 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.244689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:07.259770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4abc9-f42b-4214-8e23-44266e072853 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.315724 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.316371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.316622 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.316891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] PATH_INFO: `/v3/projects/2c2e28edcd37435e8363797644acc6be` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.318651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2e28edcd37435e8363797644acc6be)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.320474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.335655 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:07.367315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2e28edcd37435e8363797644acc6be', 'request_id': 'req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:07.373186 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2e28edcd37435e8363797644acc6be', 'request_id': 'req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:07.381461 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2e28edcd37435e8363797644acc6be', 'request_id': 'req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:07.392843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] The token cache is being invalidate because project 2c2e28edcd37435e8363797644acc6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:07.393132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:07.393780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-1944d04c-1fa8-46a4-b17b-b02d8cae08bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:07.395363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1352/2707] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:07 2022] DELETE /identity/v3/projects/2c2e28edcd37435e8363797644acc6be => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:07.400245 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.400731 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.400830 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.422004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:07.423328 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:07.484722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1356/2708] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:07.494375 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.494657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.494929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.515457 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:07.516667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:07.524583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1353/2709] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:07.528752 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.539196 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05517c-0ad7-4c8e-8316-89bf79323eab None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.543707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.544320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.544601 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.544875 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.545612 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:54:07.545943 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.547594 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.559868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1357/2710] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:54:07.564285 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.573811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8dba-9a9d-4ded-af39-f469c9cf646c None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.578467 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.579075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.579356 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.579628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.580298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.582353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.612284 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1354/2711] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:54:07 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:07.617177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.627242 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c4b7-1b2f-4453-b23e-b8dfc4b15273 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.686704 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.687341 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.687628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.687894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.688570 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.690633 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.712409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1358/2712] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:54:07 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:07.716608 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.728121 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995734c-834e-4cda-8e16-147e2fa98769 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.732672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.733305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.733612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.733881 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.734563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.736153 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.746630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1355/2713] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:54:07.750705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.761481 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa414-47b1-45a5-b109-46b5c584148b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.766132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.766747 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.767029 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.767305 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.767994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.769619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373c29-fe7f-4880-b1f4-e2ed2182515d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.780702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1359/2714] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:07.784738 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.795228 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1f6e-0fd2-4d4c-9c8f-3d934b0cca05 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.799778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.800424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.800697 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.800966 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] PATH_INFO: `/v3/projects/9a84a37ac215404384b09efbc6bc8eb0/users/3c1bad3bf96e4def8c73c6ce7a968697/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.815268 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84a37ac215404384b09efbc6bc8eb0, user_id=3c1bad3bf96e4def8c73c6ce7a968697, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:07.817978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:07.830006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1356/2715] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:07 2022] PUT /identity/v3/projects/9a84a37ac215404384b09efbc6bc8eb0/users/3c1bad3bf96e4def8c73c6ce7a968697/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:07.835686 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f0ea-0837-4a53-a6f6-61adb35abec8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.835973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f0ea-0837-4a53-a6f6-61adb35abec8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.836247 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f0ea-0837-4a53-a6f6-61adb35abec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.855837 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-78a8f0ea-0837-4a53-a6f6-61adb35abec8 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:07.857031 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78a8f0ea-0837-4a53-a6f6-61adb35abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:07.903178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:07.917480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1360/2716] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:54:07.927000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:07.928727 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:07.985148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689879c-9ec4-4cd1-a8a8-f4ee4bd0ad92 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:07.989210 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:07.989865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:07.990149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:07.990453 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:07.999474 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:08.000905 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:08.010688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1357/2717] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:08.678840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:08.679435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:08.679537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:08.710820 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] MFA Rules not processed for user `3c1bad3bf96e4def8c73c6ce7a968697`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:08.712040 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:08.785163 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1361/2718] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:08.790514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:08.800302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d70d-0104-43e1-bf53-cf9c2ede5c87 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:08.804938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:08.805689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:08.805973 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:08.806250 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:08.806922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:08.809734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:08.838795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1358/2719] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:54:08 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:54:08.843036 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:08.854555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c6647-721b-4749-a5e9-ac815ed55d92 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:08.930058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:08.930692 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:08.930993 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:08.931270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:08.931934 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:08.933873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:08.960675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1362/2720] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:54:08 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:08.965012 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:08.977562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccebb1-7498-43a8-9b43-0f3abf3aaeb8 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:08.982319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:08.983034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:08.983387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:08.983733 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:08.984495 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:08.986194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:08.997148 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1359/2721] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:09.001263 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:09.012004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b55df-7799-485c-b504-37ba82f1b8c9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:09.016563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:09.017215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:09.017528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:09.017806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] PATH_INFO: `/v3/projects/a540d299c2764983888dbd26f2cbcc33/users/4fd7071079dc4a16a160c3155f8a38fc/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:09.032844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a540d299c2764983888dbd26f2cbcc33, user_id=4fd7071079dc4a16a160c3155f8a38fc, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:09.035557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:09.048010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1363/2722] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:09 2022] PUT /identity/v3/projects/a540d299c2764983888dbd26f2cbcc33/users/4fd7071079dc4a16a160c3155f8a38fc/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:09.052131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:09.062129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456541d3-04f1-4446-b620-45f2cc371645 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:09.066657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:09.118899 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:09.119516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:09.119796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:09.120073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:09.120761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:09.122393 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e890c8-ba91-489d-9114-3a723193f225 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:09.132440 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1360/2723] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:09.137026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:09.147617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede31cd-1a0e-4f3d-baba-84a0ce6d109f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:09.152276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:09.152914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:09.153198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:09.153510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] PATH_INFO: `/v3/projects/a540d299c2764983888dbd26f2cbcc33/users/4fd7071079dc4a16a160c3155f8a38fc/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:09.155463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a540d299c2764983888dbd26f2cbcc33, user_id=4fd7071079dc4a16a160c3155f8a38fc, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:09.158133 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:09.168324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1364/2724] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:09 2022] PUT /identity/v3/projects/a540d299c2764983888dbd26f2cbcc33/users/4fd7071079dc4a16a160c3155f8a38fc/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:09.788526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:09.788815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:09.789091 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:09.817011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] MFA Rules not processed for user `4fd7071079dc4a16a160c3155f8a38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:09.818336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:09.889164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1361/2725] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:09.900929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:09.902799 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:09.947142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:09.967914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27568-fa89-4aa2-988e-a4be00ba3757 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:09.971685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:09.972557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:09.972873 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:09.974033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:10.031370 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:10.032814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:10.042719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1365/2726] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:11.431100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:11.432497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:11.444521 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cead1d-e3b8-4f80-8e4f-970f92e7bc13 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:11.448036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:11.448645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:11.448932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:11.449207 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:11.458869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:11.460473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:11.469888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1362/2727] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:15.003677 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:15.058026 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b7ed-3e2c-4276-b33f-c5359977703c service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:15.061667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:15.062282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:15.062565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:15.062842 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:15.064619 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:15.126700 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:15.128123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:15.138687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1366/2728] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:21.465795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=65 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:24.447842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:24.553497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bc799-b2f5-44c4-86d9-fa99b2ec9e96 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:24.558044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:24.558788 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:24.559071 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:24.559344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] PATH_INFO: `/v3/users/3c1bad3bf96e4def8c73c6ce7a968697` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:24.560504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1bad3bf96e4def8c73c6ce7a968697)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:24.562459 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:24.608282 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1bad3bf96e4def8c73c6ce7a968697'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.608837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1bad3bf96e4def8c73c6ce7a968697'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.616434 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1bad3bf96e4def8c73c6ce7a968697'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.617063 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1bad3bf96e4def8c73c6ce7a968697'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.628862 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1bad3bf96e4def8c73c6ce7a968697'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.640653 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1363/2729] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:24 2022] DELETE /identity/v3/users/3c1bad3bf96e4def8c73c6ce7a968697 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:24.813217 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:24.848438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96862918-9310-4ab4-b1ac-016486277a5d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:24.859835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:24.905713 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:24.906361 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:24.906646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:24.906923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] PATH_INFO: `/v3/projects/9a84a37ac215404384b09efbc6bc8eb0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:24.908082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a84a37ac215404384b09efbc6bc8eb0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:24.910584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:24.956468 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a84a37ac215404384b09efbc6bc8eb0', 'request_id': 'req-6bc46388-59c1-4bef-8969-a83d58970f94'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.963106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a84a37ac215404384b09efbc6bc8eb0', 'request_id': 'req-6bc46388-59c1-4bef-8969-a83d58970f94'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.968763 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a84a37ac215404384b09efbc6bc8eb0', 'request_id': 'req-6bc46388-59c1-4bef-8969-a83d58970f94'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.993136 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] The token cache is being invalidate because project 9a84a37ac215404384b09efbc6bc8eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:24.993435 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.994050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:24.995626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1367/2730] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:24 2022] DELETE /identity/v3/projects/9a84a37ac215404384b09efbc6bc8eb0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:24.999748 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.001126 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:25.023976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f955f81-c872-4f27-84c4-00e74cd159b9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.049468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:25.083348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.084329 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.084621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.084896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] PATH_INFO: `/v3/users/4fd7071079dc4a16a160c3155f8a38fc` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.086502 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd7071079dc4a16a160c3155f8a38fc)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.088869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.138993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd7071079dc4a16a160c3155f8a38fc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.139614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd7071079dc4a16a160c3155f8a38fc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.146444 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd7071079dc4a16a160c3155f8a38fc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.147131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd7071079dc4a16a160c3155f8a38fc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.158842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6db955a9-4d44-40a9-8d31-0ef8f6829178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd7071079dc4a16a160c3155f8a38fc'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.171168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1364/2731] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:24 2022] DELETE /identity/v3/users/4fd7071079dc4a16a160c3155f8a38fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:25.368921 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.370545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:25.387990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46388-59c1-4bef-8969-a83d58970f94 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.450549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.451326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.451608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.451888 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] PATH_INFO: `/v3/projects/a540d299c2764983888dbd26f2cbcc33` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.453080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a540d299c2764983888dbd26f2cbcc33)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.455052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.499741 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:25.511893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a540d299c2764983888dbd26f2cbcc33', 'request_id': 'req-096b925d-d4c6-4c66-a52a-04a3fddf5f91'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.518685 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a540d299c2764983888dbd26f2cbcc33', 'request_id': 'req-096b925d-d4c6-4c66-a52a-04a3fddf5f91'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.524499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a540d299c2764983888dbd26f2cbcc33', 'request_id': 'req-096b925d-d4c6-4c66-a52a-04a3fddf5f91'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.542144 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] The token cache is being invalidate because project a540d299c2764983888dbd26f2cbcc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:25.542555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.543609 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-096b925d-d4c6-4c66-a52a-04a3fddf5f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:25.546528 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1368/2732] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:25 2022] DELETE /identity/v3/projects/a540d299c2764983888dbd26f2cbcc33 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:25.555903 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.556752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.557025 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.626700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:25.628431 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:25.701328 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1365/2733] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:25.711776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.713324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.713324 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.733779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:25.735051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:25.746658 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1369/2734] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:25.750984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.761167 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db04ae9-6e28-4289-a7f7-bc5e6cd77e44 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.767536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.768164 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.768443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.768722 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.770230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:54:25.770543 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.772808 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.787522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1366/2735] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:54:25.792585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.802914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74e263-470b-4972-99da-c85ffca3121c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.807904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.808551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.808832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.809108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.809813 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.811748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.844192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1370/2736] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:54:25 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:25.849168 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.855745 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:25.860259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545f81-79f2-4139-b6db-0cfffac878b2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.925084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.925878 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.926218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.926496 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.927165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.929097 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.953900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1367/2737] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:54:25 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:54:25.958486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:25.970604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563431c-a972-41d8-9098-29b3bf4f90f6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:25.976125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:25.976743 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:25.977020 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:25.977296 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:25.978027 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:25.979621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:25.990089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1371/2738] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:54:25.994392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:26.004310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e9edb-98e1-460b-b096-3de360897960 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:26.008953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:26.009858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:26.010138 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:26.010409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:26.011124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:26.012726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94b8e-8ccd-4d8c-8d64-cbf24d0420c7 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:26.023654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1368/2739] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:54:26.027780 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:26.038715 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b6455-257c-4220-97c1-0b1dabf28947 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:26.043441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:26.044107 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:26.044391 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:26.044726 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] PATH_INFO: `/v3/projects/0faf6efbb5a141ed9e4d1bc725d33749/users/ba94fda55a7748b293185b7860a928e8/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:26.059563 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0faf6efbb5a141ed9e4d1bc725d33749, user_id=ba94fda55a7748b293185b7860a928e8, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:26.062252 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:26.075746 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1372/2740] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:54:26 2022] PUT /identity/v3/projects/0faf6efbb5a141ed9e4d1bc725d33749/users/ba94fda55a7748b293185b7860a928e8/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:54:26.086549 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:26.086841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:26.087122 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:26.114630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] MFA Rules not processed for user `ba94fda55a7748b293185b7860a928e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:26.115837 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:26.179579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1369/2741] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:26.190940 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:26.193267 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:26.265503 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212a0ce-364f-457e-b91b-45c738049d37 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:26.269062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:26.270382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:26.270735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:26.271011 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:26.279592 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:26.281052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:26.290651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1373/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:27.689078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:27.690629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:27.773133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:27.791358 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4251ef-20ac-4071-b3ce-99031ae79e54 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:27.797390 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:27.798084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:27.798311 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:27.798585 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:27.800768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:27.815705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:27.817946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715857fd-7632-4ad9-8e2d-81cb6d76cfd7 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:27.830029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1370/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:36.286577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=71,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:37.824395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=8 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:43.862172 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:43.924297 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666c65-2757-4793-99fc-dfe91a0ff0a9 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:43.929714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:43.930355 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:43.930638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:43.930915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] PATH_INFO: `/v3/users/ba94fda55a7748b293185b7860a928e8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:43.932068 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba94fda55a7748b293185b7860a928e8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:43.934006 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:43.980326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba94fda55a7748b293185b7860a928e8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:43.980967 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba94fda55a7748b293185b7860a928e8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:43.987973 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba94fda55a7748b293185b7860a928e8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:43.995342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba94fda55a7748b293185b7860a928e8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:43.996127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba94fda55a7748b293185b7860a928e8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.013885 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1374/2744] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:54:43 2022] DELETE /identity/v3/users/ba94fda55a7748b293185b7860a928e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:44.018344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:44.018829 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:44.018929 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:44.037212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:54:44.039084 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:44.096786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1371/2745] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:54:44.107261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:44.108695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:44.187326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528f725-5013-4333-9709-5f2fdea62a6c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:44.191094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:44.191709 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:44.191986 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:44.192257 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:44.201335 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:44.202843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:44.212153 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1375/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:54:44.472082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:54:44.473638 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:54:44.488853 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ccd8-186d-4f15-a84d-f553ed80c2a5 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:54:44.493778 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:54:44.494553 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:54:44.494694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:54:44.495023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] PATH_INFO: `/v3/projects/0faf6efbb5a141ed9e4d1bc725d33749` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:54:44.496229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0faf6efbb5a141ed9e4d1bc725d33749)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:54:44.498115 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:54:44.546695 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0faf6efbb5a141ed9e4d1bc725d33749', 'request_id': 'req-03e7b19f-569e-48e9-bcee-a3edb8ff0888'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.552639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0faf6efbb5a141ed9e4d1bc725d33749', 'request_id': 'req-03e7b19f-569e-48e9-bcee-a3edb8ff0888'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.560681 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0faf6efbb5a141ed9e4d1bc725d33749', 'request_id': 'req-03e7b19f-569e-48e9-bcee-a3edb8ff0888'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.572065 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] The token cache is being invalidate because project 0faf6efbb5a141ed9e4d1bc725d33749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:54:44.572357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.572980 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:54:44.574519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1372/2747] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:54:44 2022] DELETE /identity/v3/projects/0faf6efbb5a141ed9e4d1bc725d33749 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:54:54.207924 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:54.569008 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:21.545085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:56:21.554180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948f5d-afb4-402d-883c-f92a4f5ae2bf service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:56:21.601942 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:56:21.602555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:21.602835 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:21.603123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:21.604893 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:21.693819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:56:21.695258 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9889-75dc-40aa-b4b0-9fe20186ba55 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:56:21.715383 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1376/2748] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:56:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:56:22.528017 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:56:22.529407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:22.542204 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7b19f-569e-48e9-bcee-a3edb8ff0888 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:56:22.545758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:56:22.546365 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:22.546644 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:22.546917 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:22.548573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:22.561766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:56:22.563190 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:56:22.574728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1373/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:56:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:56:29.144246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:29.144798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:29.144798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:29.165718 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] MFA Rules not processed for user `20da01b3f86d40cfa84762492eea43f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:56:29.166931 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:29.221377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1377/2750] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:56:32.569721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:36.042129 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:56:36.043558 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:36.055118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c2f7-265b-4a5c-816a-8c2571a54587 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:56:36.059357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:56:36.060263 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:36.060773 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:36.061283 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:36.063796 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:36.082686 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:56:36.084700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:56:36.100907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1374/2751] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:56:36.226822 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:56:36.237100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51878-6d98-4cee-9219-ec07659b2998 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:56:36.242191 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:56:36.243243 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:36.243720 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:36.244182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:36.246275 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:36.264177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:56:36.265801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:56:36.278010 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1378/2752] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:56:46.092752 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:46.272784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:48.992715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:56:49.001401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49c30-d560-40af-bf90-170c7b525db7 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:56:49.005869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:56:49.006475 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:56:49.006754 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:56:49.007027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:56:49.008734 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:56:49.018786 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:56:49.020404 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:56:49.028419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1375/2753] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:56:59.024870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:46.417598 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:46.419075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:46.434299 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c043-da86-48fb-ae66-562d2e5e2cb0 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:46.440409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:46.441171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:46.441606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:46.441938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:46.444175 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:46.458745 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:46.460576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:46.477607 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1379/2754] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:57:54.468708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:54.470156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:54.545520 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb889b3e-9b3b-4000-9e44-6c4dca8fb5e1 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:54.549988 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:54.550629 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:54.550911 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:54.551185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] PATH_INFO: `/v3/users/20da01b3f86d40cfa84762492eea43f1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:54.552350 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20da01b3f86d40cfa84762492eea43f1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:54.554357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:54.602221 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20da01b3f86d40cfa84762492eea43f1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.602800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20da01b3f86d40cfa84762492eea43f1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.610202 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20da01b3f86d40cfa84762492eea43f1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.610843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20da01b3f86d40cfa84762492eea43f1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.622689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3eef80fe-6911-4d48-8edb-eb88b0e99299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20da01b3f86d40cfa84762492eea43f1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.635249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1376/2755] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:57:54 2022] DELETE /identity/v3/users/20da01b3f86d40cfa84762492eea43f1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:54.809433 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:54.821870 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f15a2d-e3ac-42e8-9ab6-7a1be1b3afa8 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:54.880441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:54.881092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:54.881375 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:54.881680 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] PATH_INFO: `/v3/projects/69ac15e2b1074938adfa7615f1ff1495` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:54.882836 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ac15e2b1074938adfa7615f1ff1495)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:54.885379 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:54.930034 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ac15e2b1074938adfa7615f1ff1495', 'request_id': 'req-d1c18c37-7eec-4e76-bb97-58587b00a22f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.936604 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ac15e2b1074938adfa7615f1ff1495', 'request_id': 'req-d1c18c37-7eec-4e76-bb97-58587b00a22f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.942054 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ac15e2b1074938adfa7615f1ff1495', 'request_id': 'req-d1c18c37-7eec-4e76-bb97-58587b00a22f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.954496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] The token cache is being invalidate because project 69ac15e2b1074938adfa7615f1ff1495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:57:54.954782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.955423 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d1c18c37-7eec-4e76-bb97-58587b00a22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:54.956905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1380/2756] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:57:54 2022] DELETE /identity/v3/projects/69ac15e2b1074938adfa7615f1ff1495 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:54.961795 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:54.962082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:54.962547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:54.982198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:57:54.983378 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:55.041662 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1377/2757] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:57:55.049373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940089-d0de-4843-a708-af33ea17a99d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.049687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940089-d0de-4843-a708-af33ea17a99d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.049964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940089-d0de-4843-a708-af33ea17a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.070151 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-94940089-d0de-4843-a708-af33ea17a99d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:57:55.071351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94940089-d0de-4843-a708-af33ea17a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:55.079871 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1381/2758] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:57:55.083871 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.093527 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92d43-5cea-421e-8f4f-51a61f6a1fff None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.098003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.098607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.098887 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.099161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.099847 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:57:55.100152 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.101768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.113770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1378/2759] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:57:55.117881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940089-d0de-4843-a708-af33ea17a99d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.127555 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940089-d0de-4843-a708-af33ea17a99d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.132165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.132758 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.133035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.133303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.133996 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.136180 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.171895 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1382/2760] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:57:55.175931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.186569 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af15e-b4e1-4e29-915e-870d0de8cda6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.190174 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:55.243185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.243800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.244659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.244977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.245712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.247613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.268256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1379/2761] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:57:55.273285 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.284353 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa162949-9eb0-445e-ab04-2d52ba5097aa admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.289050 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.289691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.289972 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.290248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.291438 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.293083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.302840 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1383/2762] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:57:55.307483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.317479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebec3-6fef-49c7-bfbf-481ebfa1dcca admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.322040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.322713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.322990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.323264 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.323947 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.325542 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8e5c6-b01c-4f01-9f4e-d26c512a0813 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.335883 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1380/2763] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:57:55.340092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.349977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c0397-54a3-4990-b2b3-6e58365a16d8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.355342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.355989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.356272 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.356550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] PATH_INFO: `/v3/projects/22b5a7337bb749099ff71b7e95d64bc1/users/d95c4bf9a0c549c78e5cf7f82673a0b3/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.371705 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b5a7337bb749099ff71b7e95d64bc1, user_id=d95c4bf9a0c549c78e5cf7f82673a0b3, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.374376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.387521 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1384/2764] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:57:55 2022] PUT /identity/v3/projects/22b5a7337bb749099ff71b7e95d64bc1/users/d95c4bf9a0c549c78e5cf7f82673a0b3/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:55.398978 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.399265 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.399541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.427233 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] MFA Rules not processed for user `d95c4bf9a0c549c78e5cf7f82673a0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:57:55.428424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:55.492591 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1381/2765] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:57:55.497164 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.503062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:55.560707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec398a-91f4-446c-a09a-978a38b224e3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.565361 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.566039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.566348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.566626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.567325 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.570082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.599085 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1385/2766] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:57:55.603082 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.614160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6069-6ef1-4f5b-839c-95a844ba8b51 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.669515 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.670131 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.670412 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.670712 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.671377 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.673322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.693660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1382/2767] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:57:55.697776 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.708210 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375af017-889c-4f88-b7ca-4fbc510ae83b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.713373 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.714062 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.714343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.714624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.715534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.716938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.727490 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1386/2768] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:57:55.732297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.738627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:55.742424 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ab91b-f3d8-4011-999f-9bfd65b28c68 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.748483 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.749150 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.749450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.749768 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] PATH_INFO: `/v3/projects/90359f592e03415093016d1218184bdf/users/219b17fb1f984cb590aa07d72a627a22/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.764946 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90359f592e03415093016d1218184bdf, user_id=219b17fb1f984cb590aa07d72a627a22, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.767639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.781349 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1383/2769] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:57:55 2022] PUT /identity/v3/projects/90359f592e03415093016d1218184bdf/users/219b17fb1f984cb590aa07d72a627a22/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:55.785501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.797768 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72218cd-0fb5-4de6-a786-47513f56496b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.859049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.859049 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.859721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.859721 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.860127 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.861735 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3319c9a-db24-426b-aec6-84ec4aea8f94 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.872550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1387/2770] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:57:55.877191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:55.889447 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03bbe-5890-4d6d-a5d8-1c0e34f99d76 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:55.894308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:55.894975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.895256 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.895531 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] PATH_INFO: `/v3/projects/90359f592e03415093016d1218184bdf/users/219b17fb1f984cb590aa07d72a627a22/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.897599 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90359f592e03415093016d1218184bdf, user_id=219b17fb1f984cb590aa07d72a627a22, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:55.901803 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:55.913102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1384/2771] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:57:55 2022] PUT /identity/v3/projects/90359f592e03415093016d1218184bdf/users/219b17fb1f984cb590aa07d72a627a22/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:55.923377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:55.923669 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:55.923948 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:55.951909 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] MFA Rules not processed for user `219b17fb1f984cb590aa07d72a627a22`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:57:55.953128 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:56.018156 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:56.022008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1388/2772] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:57:56.034066 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:56.035852 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:56.119977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960e96-06a2-4786-8721-e9b172f3775f admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:56.124249 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:56.124965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:56.125254 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:56.125561 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:56.135198 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:56.137098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:56.146489 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1385/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:57:56.221178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:56.231320 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425621fc-d11b-4f4f-9299-00bd730ef6ad None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:56.234933 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:56.235549 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:56.235832 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:56.236109 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:56.294115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:56.295543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd202d9-fb69-41fe-9092-f1871afc017c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:56.304378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1389/2774] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:57:59.016179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:59.077149 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644d74-5ace-4a5e-9b33-df0799173fa0 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:59.081699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:59.082335 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:59.082617 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:59.082888 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] PATH_INFO: `/v3/users/d95c4bf9a0c549c78e5cf7f82673a0b3` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:59.084036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95c4bf9a0c549c78e5cf7f82673a0b3)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:59.086023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:59.134319 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95c4bf9a0c549c78e5cf7f82673a0b3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.136000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95c4bf9a0c549c78e5cf7f82673a0b3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.139741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:59.143307 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95c4bf9a0c549c78e5cf7f82673a0b3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.144297 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95c4bf9a0c549c78e5cf7f82673a0b3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.158897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95c4bf9a0c549c78e5cf7f82673a0b3'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.171904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1386/2775] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:57:59 2022] DELETE /identity/v3/users/d95c4bf9a0c549c78e5cf7f82673a0b3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:59.176403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:59.176881 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:59.177003 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:59.196326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:57:59.198142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:59.254959 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1390/2776] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:57:59.265401 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:59.266840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:59.324171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9548c65-27fa-4ef5-9134-361b4f906923 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:59.327832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:59.328448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:59.328730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:59.329006 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:59.338657 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:59.340083 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:59.349524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1387/2777] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:57:59.623812 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:59.625234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:57:59.639466 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc3e4-3387-41d6-a02e-e3e7cd160e8d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:59.644123 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:59.644770 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:59.645052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:59.645326 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] PATH_INFO: `/v3/projects/22b5a7337bb749099ff71b7e95d64bc1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:59.647317 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b5a7337bb749099ff71b7e95d64bc1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:59.649220 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:59.696636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b5a7337bb749099ff71b7e95d64bc1', 'request_id': 'req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.703100 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b5a7337bb749099ff71b7e95d64bc1', 'request_id': 'req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.708623 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b5a7337bb749099ff71b7e95d64bc1', 'request_id': 'req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.720814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] The token cache is being invalidate because project 22b5a7337bb749099ff71b7e95d64bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:57:59.721106 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.721756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.723310 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1391/2778] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:57:59 2022] DELETE /identity/v3/projects/22b5a7337bb749099ff71b7e95d64bc1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:57:59.727292 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:57:59.737294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c7a-1103-4bd1-90fb-fd39e822d906 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:57:59.793958 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:57:59.794526 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:57:59.794804 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:57:59.795098 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] PATH_INFO: `/v3/users/219b17fb1f984cb590aa07d72a627a22` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:57:59.796235 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=219b17fb1f984cb590aa07d72a627a22)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:57:59.798234 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:57:59.843907 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219b17fb1f984cb590aa07d72a627a22'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.844546 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219b17fb1f984cb590aa07d72a627a22'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.851737 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219b17fb1f984cb590aa07d72a627a22'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.852346 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219b17fb1f984cb590aa07d72a627a22'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.864603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3708f7ca-a279-45ae-8271-9d22519227ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219b17fb1f984cb590aa07d72a627a22'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:57:59.866563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:59.878790 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1388/2779] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:57:59 2022] DELETE /identity/v3/users/219b17fb1f984cb590aa07d72a627a22 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:00.152534 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.154125 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:00.168075 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbeb6-f9e6-4fae-8041-8c0260f61cdb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.190764 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:00.231932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.232602 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.232883 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.233161 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] PATH_INFO: `/v3/projects/90359f592e03415093016d1218184bdf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.234357 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90359f592e03415093016d1218184bdf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.236244 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.281514 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90359f592e03415093016d1218184bdf', 'request_id': 'req-53a4aa1e-0281-4d27-83f4-46d046a154d8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:00.287471 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90359f592e03415093016d1218184bdf', 'request_id': 'req-53a4aa1e-0281-4d27-83f4-46d046a154d8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:00.293550 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90359f592e03415093016d1218184bdf', 'request_id': 'req-53a4aa1e-0281-4d27-83f4-46d046a154d8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:00.305684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] The token cache is being invalidate because project 90359f592e03415093016d1218184bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:58:00.305969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:00.306710 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-53a4aa1e-0281-4d27-83f4-46d046a154d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:00.308209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1392/2780] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:58:00 2022] DELETE /identity/v3/projects/90359f592e03415093016d1218184bdf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:00.313845 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.314308 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.314406 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.333928 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:00.335042 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:00.392225 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1389/2781] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:00.399843 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.400712 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.400990 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.420190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:00.421376 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:00.429105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1393/2782] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:00.433222 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.443005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0905b-ce03-44d3-a41b-ad8593ca35b6 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.448294 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.448897 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.449173 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.449468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.450159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:58:00.450463 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.452057 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.463894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1390/2783] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:58:00.468098 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.477219 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5e28c-aff4-4ff3-81d1-93d84b872976 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.481851 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.482446 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.482722 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.482991 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.483646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.485558 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.511984 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1394/2784] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:58:00.516048 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.526493 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca730-1ea1-4004-af51-2dbd9815969c admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.581945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.582777 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.583061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.583337 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.584075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.586077 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.607661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1391/2785] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:00.611805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.623058 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cb5c-e9eb-475f-8312-5ce628b9591d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.627759 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.628364 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.628646 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.628922 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.629660 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.631270 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.641790 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1395/2786] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:00.645586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.655877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a3e5-d70b-4f11-848a-c044dde19389 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.660809 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.661352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.661352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.661611 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.662343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.664055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532d1b-7dac-4c48-85f5-ddf92716a35a admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.675272 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1392/2787] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:58:00.679380 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.690292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af26c-1ae5-4901-bd9c-6924336102bb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.694862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.695516 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.695796 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.696070 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] PATH_INFO: `/v3/projects/31c9d0d1a426456bb8775f329313161f/users/6109efb58d32477bbc6d2942341526b5/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.710557 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c9d0d1a426456bb8775f329313161f, user_id=6109efb58d32477bbc6d2942341526b5, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.713811 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.726590 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1396/2788] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:00 2022] PUT /identity/v3/projects/31c9d0d1a426456bb8775f329313161f/users/6109efb58d32477bbc6d2942341526b5/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:00.738758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.739037 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.739309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.766802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] MFA Rules not processed for user `6109efb58d32477bbc6d2942341526b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:00.768015 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:00.814130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:00.833834 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1393/2789] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:00.839179 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.890756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:00.905899 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85630-fa10-4aba-9132-35f87174fa31 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:00.910584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:00.911203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:00.911493 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:00.911818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:00.912494 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:00.914431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:00.940869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1397/2790] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:00.944835 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:00.955445 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1febe-65b1-4e82-9137-54888cbeb5e1 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.012807 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.013426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.013718 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.013990 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.014651 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.016550 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.037694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1394/2791] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:58:00 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:01.042459 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:01.052733 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7f2-35a2-45d7-817e-0bc04c91a841 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.057585 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.058190 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.058474 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.058751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.059436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.061021 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.071455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1398/2792] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:01.075991 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:01.085870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8e205-e5b1-4a64-8be1-f37abfaa4b46 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.091069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.091692 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.091972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.092245 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] PATH_INFO: `/v3/projects/5d1111e75c29425ea6f7cdc245d7588a/users/b6d1ab8e13604332950719e27dfce47d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.106701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1111e75c29425ea6f7cdc245d7588a, user_id=b6d1ab8e13604332950719e27dfce47d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.109347 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.121825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1395/2793] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:01 2022] PUT /identity/v3/projects/5d1111e75c29425ea6f7cdc245d7588a/users/b6d1ab8e13604332950719e27dfce47d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:01.125631 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:01.136316 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f96b-a6c9-4061-ae87-12859b556fb9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.191398 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.192945 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.193228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.193535 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.194232 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.195850 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80342b6-ef01-49fa-9496-591a53132389 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.206492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1399/2794] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:58:01.210670 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:01.221648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f4ed-95f2-4f73-b05e-c625445efeb3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.226314 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.226971 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.227253 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.227530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] PATH_INFO: `/v3/projects/5d1111e75c29425ea6f7cdc245d7588a/users/b6d1ab8e13604332950719e27dfce47d/roles/49c473efb0f54f149c348fb507115880` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.229605 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1111e75c29425ea6f7cdc245d7588a, user_id=b6d1ab8e13604332950719e27dfce47d, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.232227 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.242214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1396/2795] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:01 2022] PUT /identity/v3/projects/5d1111e75c29425ea6f7cdc245d7588a/users/b6d1ab8e13604332950719e27dfce47d/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:01.252253 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.252546 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.252827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.282130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] MFA Rules not processed for user `b6d1ab8e13604332950719e27dfce47d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:01.283338 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:01.350189 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1400/2796] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:01.360694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:01.362416 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:01.419725 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7705ceb-3c9e-4c9b-978b-3b6efed9a89b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:01.423458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:01.424073 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:01.424352 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:01.424625 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:01.477118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:01.481194 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:01.483508 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:01.492792 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1397/2797] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:07.129637 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:07.131051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:07.143497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b11f0-d797-4d31-83ab-18700b894e7c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:07.147142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:07.147798 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:07.148079 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:07.148351 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:07.158929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:07.160362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:07.170595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1401/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:58:11.488904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:17.166636 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:20.470562 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:20.472230 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:20.586498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad56a-fa53-4f18-9ab1-a1e894382e9c service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:20.591409 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:20.592027 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:20.592304 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:20.592574 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:20.594579 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:20.606621 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:20.608203 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:20.618668 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1398/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:23.618313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:23.629987 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d438-3e3d-4620-a57a-67ec044c2eed service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:23.635159 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:23.635861 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:23.636541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:23.636929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:23.638791 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:23.650617 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:23.653041 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:23.664510 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1402/2800] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:23.678779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:23.680811 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:23.749316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c890d-9040-4044-929d-e19cd201eca1 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:23.753872 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:23.754507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:23.754783 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:23.755079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] PATH_INFO: `/v3/users/2a98ee7a5076425aa7cf6cb2107da67f` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:23.756699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a98ee7a5076425aa7cf6cb2107da67f)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:23.758700 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:23.804667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a98ee7a5076425aa7cf6cb2107da67f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:23.805305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a98ee7a5076425aa7cf6cb2107da67f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:23.813132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a98ee7a5076425aa7cf6cb2107da67f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:23.813823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a98ee7a5076425aa7cf6cb2107da67f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:23.827491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a98ee7a5076425aa7cf6cb2107da67f'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:23.840678 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1399/2801] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:58:23 2022] DELETE /identity/v3/users/2a98ee7a5076425aa7cf6cb2107da67f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:24.025187 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.036688 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abad22-fb19-4cf9-8662-09fd00c7236c service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:24.111281 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:24.111928 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.112248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.112567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] PATH_INFO: `/v3/projects/8fd8c34715e54a778911a8410e095800` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.114248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd8c34715e54a778911a8410e095800)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:24.116276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:24.165224 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd8c34715e54a778911a8410e095800', 'request_id': 'req-432782ba-2692-4b9e-9a00-858f9187d32e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.172406 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd8c34715e54a778911a8410e095800', 'request_id': 'req-432782ba-2692-4b9e-9a00-858f9187d32e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.179651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd8c34715e54a778911a8410e095800', 'request_id': 'req-432782ba-2692-4b9e-9a00-858f9187d32e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.194274 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] The token cache is being invalidate because project 8fd8c34715e54a778911a8410e095800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:58:24.194562 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.195234 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.201444 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1403/2802] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:58:24 2022] DELETE /identity/v3/projects/8fd8c34715e54a778911a8410e095800 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:24.202218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.203770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.219673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ae09-e962-4d2a-84b0-9276e6f83713 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:24.225630 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:24.281029 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:24.281707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.281987 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.282261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] PATH_INFO: `/v3/users/6c3c61baefc34aa4a5f5fdfdef146540` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.283713 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3c61baefc34aa4a5f5fdfdef146540)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:24.285675 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:24.330885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3c61baefc34aa4a5f5fdfdef146540'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.331524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3c61baefc34aa4a5f5fdfdef146540'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.338516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3c61baefc34aa4a5f5fdfdef146540'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.339635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3c61baefc34aa4a5f5fdfdef146540'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.351177 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3c61baefc34aa4a5f5fdfdef146540'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.363690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1400/2803] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:58:24 2022] DELETE /identity/v3/users/6c3c61baefc34aa4a5f5fdfdef146540 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:24.373065 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.374497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.433047 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432782ba-2692-4b9e-9a00-858f9187d32e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:24.462583 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:24.484101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:24.484695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.484970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.485238 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.486992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.547302 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:24.548719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9f2b-a435-4b33-a958-0af78e5b8173 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:24.559450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1404/2804] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:24.726682 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.728161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.743566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc33d7a-83c9-49e8-b6df-595fce67c4a2 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:24.749075 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:24.749900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.750274 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.750448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] PATH_INFO: `/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.751728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfbf5e35faf453b8267534f53d0d5f7)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:24.753619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:24.801408 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfbf5e35faf453b8267534f53d0d5f7', 'request_id': 'req-631036c6-66f2-4431-9fd3-5f9b3809dd6c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.807330 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfbf5e35faf453b8267534f53d0d5f7', 'request_id': 'req-631036c6-66f2-4431-9fd3-5f9b3809dd6c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.814715 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfbf5e35faf453b8267534f53d0d5f7', 'request_id': 'req-631036c6-66f2-4431-9fd3-5f9b3809dd6c'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.826325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] The token cache is being invalidate because project 9bfbf5e35faf453b8267534f53d0d5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:58:24.826613 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.827241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-631036c6-66f2-4431-9fd3-5f9b3809dd6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:24.828730 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1401/2805] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:58:24 2022] DELETE /identity/v3/projects/9bfbf5e35faf453b8267534f53d0d5f7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:24.833651 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.834140 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.834269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.854591 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:24.856060 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.915113 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1405/2806] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:24.922989 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.923277 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.923556 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.943904 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:24.945089 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:24.953399 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1402/2807] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:24.957566 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.968409 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1b014-5f1a-4bab-a198-e005a3b48457 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:24.973206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:24.973806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:24.974083 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:24.974354 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:24.975039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:58:24.975337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:24.976915 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:24.988419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1406/2808] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:58:24.992846 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:24.998997 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:25.003781 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf16cd-c4cd-4cba-83e3-2a4eb2f8c83d None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.010136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.010945 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.011955 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.012322 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.013229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.015394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.042402 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1403/2809] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:58:24 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:58:25.046748 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:25.056565 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64050-6755-477f-bd5c-4e7bc05510ee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.112350 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.112989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.113269 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.113575 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.114248 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.116218 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.132288 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:25.139306 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1407/2810] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:58:25 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:58:25.143342 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:25.153443 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee7c29-3f0e-4bbf-9bbb-6fbedcaf7479 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.157948 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.158551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.158832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.159106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.159794 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.161380 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.171810 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1404/2811] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:25.175808 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:25.186463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccc3f-0876-4ccd-bbf2-50169b1440fd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.191360 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.192008 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.192291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.192599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.193290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.194989 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f6f86-adda-48dc-8c44-4da50965d891 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.206573 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1408/2812] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:25.210856 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:25.220741 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f835b3-d191-4dd0-8a6c-13941e872246 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.225368 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.225998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.226288 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.226547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] PATH_INFO: `/v3/projects/50680cfc97cf41c18d074cb84493cde7/users/5f9d278bd76c4ce0b90b8307b3c7d1f2/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.241534 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50680cfc97cf41c18d074cb84493cde7, user_id=5f9d278bd76c4ce0b90b8307b3c7d1f2, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.244166 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.259759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1405/2813] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:25 2022] PUT /identity/v3/projects/50680cfc97cf41c18d074cb84493cde7/users/5f9d278bd76c4ce0b90b8307b3c7d1f2/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:25.265527 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f926-d103-412b-83cc-db3d18812d26 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.265818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f926-d103-412b-83cc-db3d18812d26 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.266094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f926-d103-412b-83cc-db3d18812d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.285078 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7b59f926-d103-412b-83cc-db3d18812d26 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:25.286322 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7b59f926-d103-412b-83cc-db3d18812d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:25.346056 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1409/2814] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:25.355600 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:25.357257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:25.413900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923e768-1162-44a0-9783-269001275e91 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:25.418087 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:25.418694 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:25.418972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:25.419244 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:25.427999 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:25.429405 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:25.439360 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1406/2815] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:29.511756 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:29.512463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:29.512463 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:29.545044 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] MFA Rules not processed for user `5f9d278bd76c4ce0b90b8307b3c7d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:29.546495 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:29.630757 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1410/2816] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:29.632160 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:29.658501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cc6c-71bd-4569-a476-4f93856a7960 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:29.697906 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:29.699627 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:29.699915 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:29.700211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:29.700891 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:29.703426 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:29.755598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1407/2817] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:58:29 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:29.759586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:29.774750 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3134aa-7e42-4927-9de3-0bd16faa8aaa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:29.856608 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:29.857540 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:29.857917 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:29.858597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:29.859356 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:29.861681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:29.911097 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1411/2818] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:58:29 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:58:29.915086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:29.929840 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc05e2a-d4ae-4d00-a4ae-81d65b61f033 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:29.935279 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:29.936055 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:29.936407 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:29.936756 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:29.937563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:29.949436 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:29.958472 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1408/2819] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:29.962307 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:29.977977 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4ae0-6d3a-47a2-9f34-450e0ff04d70 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:29.993455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:29.993455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:29.993455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:29.993455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] PATH_INFO: `/v3/projects/1ecd2c66fb99437595a0631de1ea6357/users/d988f8fe09504b2eb7caea58d9c0bc9a/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:30.010749 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:30.025174 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecd2c66fb99437595a0631de1ea6357, user_id=d988f8fe09504b2eb7caea58d9c0bc9a, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:30.028228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:30.046788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1412/2820] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:29 2022] PUT /identity/v3/projects/1ecd2c66fb99437595a0631de1ea6357/users/d988f8fe09504b2eb7caea58d9c0bc9a/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:30.050664 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:30.063779 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe28ff-3fec-4081-a4d1-cc00a967ef77 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:30.156885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:30.157926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:30.158462 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:30.159046 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:30.159922 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:30.162078 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:30.187698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1409/2821] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:58:30.191343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:30.205223 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b921-a210-4815-8723-b53378a978d8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:30.210894 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:30.211640 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:30.211919 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:30.212497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] PATH_INFO: `/v3/projects/1ecd2c66fb99437595a0631de1ea6357/users/d988f8fe09504b2eb7caea58d9c0bc9a/roles/49c473efb0f54f149c348fb507115880` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:30.215369 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecd2c66fb99437595a0631de1ea6357, user_id=d988f8fe09504b2eb7caea58d9c0bc9a, role_id=49c473efb0f54f149c348fb507115880)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:30.219157 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14d2b-71a8-40f5-bfef-6fda4a7ce0ec admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:30.233018 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1413/2822] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:30 2022] PUT /identity/v3/projects/1ecd2c66fb99437595a0631de1ea6357/users/d988f8fe09504b2eb7caea58d9c0bc9a/roles/49c473efb0f54f149c348fb507115880 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:32.383068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:32.386842 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:32.407086 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61c3a6-f452-4f91-b445-79f6f1406e7b admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:32.420827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:32.509460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:32.512011 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:32.512815 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:32.513822 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] PATH_INFO: `/v3/users/6109efb58d32477bbc6d2942341526b5` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:32.515896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6109efb58d32477bbc6d2942341526b5)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:32.518112 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:32.602855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6109efb58d32477bbc6d2942341526b5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:32.603530 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6109efb58d32477bbc6d2942341526b5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:32.615816 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6109efb58d32477bbc6d2942341526b5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:32.617501 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6109efb58d32477bbc6d2942341526b5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:32.636102 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6109efb58d32477bbc6d2942341526b5'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:32.659018 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1410/2823] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:58:32 2022] DELETE /identity/v3/users/6109efb58d32477bbc6d2942341526b5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:32.663308 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:32.663825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:32.663949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:32.703788 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:32.705154 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:32.811382 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1414/2824] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:32.822646 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:32.824480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:32.934688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ab15-c63b-44c2-999c-aa9de4c228c9 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:32.938479 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:32.939403 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:32.939690 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:32.940041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:32.954639 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:32.956116 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:32.981184 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1411/2825] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:33.678615 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:33.681805 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:33.704782 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04cefb-e80c-4ea7-bddf-0b7a79cc7613 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:33.727088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:33.727974 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:33.731734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:33.732313 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] PATH_INFO: `/v3/projects/31c9d0d1a426456bb8775f329313161f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:33.735167 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c9d0d1a426456bb8775f329313161f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:33.740287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:33.869574 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c9d0d1a426456bb8775f329313161f', 'request_id': 'req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:33.888492 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c9d0d1a426456bb8775f329313161f', 'request_id': 'req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:33.911403 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c9d0d1a426456bb8775f329313161f', 'request_id': 'req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:33.943142 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] The token cache is being invalidate because project 31c9d0d1a426456bb8775f329313161f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:58:33.943377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:33.944407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:33.957043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1415/2826] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:58:33 2022] DELETE /identity/v3/projects/31c9d0d1a426456bb8775f329313161f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:33.961357 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:33.978309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d694-0187-4b9b-b377-73512b3ce58f service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:34.091698 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:34.141321 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:34.142458 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:34.143568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:34.144093 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] PATH_INFO: `/v3/users/b6d1ab8e13604332950719e27dfce47d` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:34.147428 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d1ab8e13604332950719e27dfce47d)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:34.161133 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:34.287654 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d1ab8e13604332950719e27dfce47d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:34.294418 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d1ab8e13604332950719e27dfce47d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:34.308367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d1ab8e13604332950719e27dfce47d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:34.309275 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d1ab8e13604332950719e27dfce47d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:34.344315 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-3a4f799f-d71a-4383-97de-251829c5bfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d1ab8e13604332950719e27dfce47d'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:34.393976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1412/2827] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:58:33 2022] DELETE /identity/v3/users/b6d1ab8e13604332950719e27dfce47d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:34.923476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:34.925082 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:34.941797 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360d2db-3e8e-4304-9fb1-d86c2ab83eb4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.019035 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:35.025593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.027132 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.028304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.028801 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] PATH_INFO: `/v3/projects/5d1111e75c29425ea6f7cdc245d7588a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.030303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1111e75c29425ea6f7cdc245d7588a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.033147 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.119170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1111e75c29425ea6f7cdc245d7588a', 'request_id': 'req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:35.129347 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1111e75c29425ea6f7cdc245d7588a', 'request_id': 'req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:35.137201 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1111e75c29425ea6f7cdc245d7588a', 'request_id': 'req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:35.154999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] The token cache is being invalidate because project 5d1111e75c29425ea6f7cdc245d7588a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:58:35.155294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:35.155949 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-27ce0bfe-a4f4-4306-9fc2-89622a9e5a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:58:35.157702 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1416/2828] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:58:34 2022] DELETE /identity/v3/projects/5d1111e75c29425ea6f7cdc245d7588a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:58:35.163751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127931-abb1-491a-9e6b-967d564e645b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.165156 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127931-abb1-491a-9e6b-967d564e645b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.169729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127931-abb1-491a-9e6b-967d564e645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.201473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-e8127931-abb1-491a-9e6b-967d564e645b None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:35.203270 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e8127931-abb1-491a-9e6b-967d564e645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.285924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1413/2829] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:35.329145 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.329497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.329779 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.359867 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.360147 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.360425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.366724 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] MFA Rules not processed for user `d988f8fe09504b2eb7caea58d9c0bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:35.368015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.392801 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:35.394348 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.405524 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1414/2830] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 11:58:35.410514 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.421821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d64bf1-6760-46d2-9dcb-30b4ec3701c7 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.426885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.427507 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.427882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.428068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.428759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:58:35.429068 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.430729 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.446104 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1415/2831] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:58:35.447567 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1417/2832] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:35.450757 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.461782 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69273c-e926-4c0e-9499-f1324e53efee admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.464719 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.466448 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.467580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.468317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.468708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.469064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] PATH_INFO: `/v3/projects` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.469858 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.471896 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.505482 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1416/2833] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:35.509688 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.526305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:35.556069 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e082f6-a4ed-486f-b721-1a4af24037c1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.562039 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:35.586415 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d3221-97a0-42d8-a3c8-66a117d47790 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.594865 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.595607 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.595957 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.596305 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.597049 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.599114 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.624827 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1417/2834] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:58:35.628900 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.640400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172dd5b-4ca3-45d4-bbe3-bec2b1b92d48 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.641198 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.641880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.642165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.642441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.644372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.645614 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.646343 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.646689 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.647034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.647728 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.649504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.661914 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1418/2835] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:58:35.665975 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.677031 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cced3-9cb7-4ee3-88b0-3f84b035d067 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.684159 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.685772 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.686513 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.686996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.688259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.691113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.705814 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1419/2836] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:58:35.710193 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.716691 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.718337 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2fab5-6b16-4568-adf6-f17f285f99ca service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.720797 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619126-3eba-4d50-856b-be5a439d94c1 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.725597 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.726298 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.726645 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.726982 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] PATH_INFO: `/v3/projects/91aa577ac9bf45a49209c232a2237b81/users/7531d3cff80c4c889c7ca3bcaab3afcf/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.728900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1418/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:35.743544 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91aa577ac9bf45a49209c232a2237b81, user_id=7531d3cff80c4c889c7ca3bcaab3afcf, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.746672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.760626 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1420/2838] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:58:35 2022] PUT /identity/v3/projects/91aa577ac9bf45a49209c232a2237b81/users/7531d3cff80c4c889c7ca3bcaab3afcf/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 11:58:35.767292 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa61d-64df-4b06-bdc4-b74f00caa7bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.767584 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa61d-64df-4b06-bdc4-b74f00caa7bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.767855 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa61d-64df-4b06-bdc4-b74f00caa7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.788456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2f2aa61d-64df-4b06-bdc4-b74f00caa7bb None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:35.789786 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f2aa61d-64df-4b06-bdc4-b74f00caa7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.873537 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1419/2839] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:35.879916 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:35.881802 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:35.949302 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891717-66f8-4f33-ac38-dea665295a4d admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:35.953257 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:35.953932 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:35.954212 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:35.954647 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:35.965491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:35.966952 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:35.988306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1421/2840] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:36.815695 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7bc5-a3d3-4392-9dcf-11c03dc83785 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:36.816250 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7bc5-a3d3-4392-9dcf-11c03dc83785 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:36.816579 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7bc5-a3d3-4392-9dcf-11c03dc83785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:36.848455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d98d7bc5-a3d3-4392-9dcf-11c03dc83785 None None] MFA Rules not processed for user `7531d3cff80c4c889c7ca3bcaab3afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:36.849539 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d98d7bc5-a3d3-4392-9dcf-11c03dc83785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:36.894362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:36.937497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1420/2841] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:36.946052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:36.947603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:37.037993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812ff7d-d59a-40c7-965c-ff96d00519d9 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:37.041717 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:37.042450 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:37.042789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:37.043130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:37.055913 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:37.058691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:37.069648 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1422/2842] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:38.516819 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:38.517319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:38.517524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:38.545081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] MFA Rules not processed for user `7531d3cff80c4c889c7ca3bcaab3afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:38.546457 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:38.553543 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1421/2843] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:38.858395 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:38.862889 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:38.868898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9993-a1e5-40a2-b54d-9120910f7990 service cinder] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:38.875124 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:38.875759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:38.876041 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:38.876316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:38.878123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:38.889477 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:38.890924 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:38.899565 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1423/2844] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:39.237914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:39.239366 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:39.320017 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9c64a-9c99-4522-b985-b287f21aed0b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:39.325865 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:39.326508 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:39.326774 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:39.327051 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:39.328827 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:39.340407 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:39.342015 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d42c4-9e93-4630-ac4b-b97a3485c6a7 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:39.351892 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1422/2845] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:47.733290 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:58:47.734821 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:47.813410 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269cd3b-fba6-40ca-abae-e85c1b739d99 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:58:47.818818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:58:47.819432 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:47.819707 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:47.819976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:47.821935 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:47.835419 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:58:47.837003 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc18f-9a71-4c89-9e3f-9835884aed83 service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:58:47.848261 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1424/2846] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:58:49.347681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=46 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:53.492994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:53.493664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:53.493664 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:53.512667 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] MFA Rules not processed for user `5f9d278bd76c4ce0b90b8307b3c7d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:53.513880 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:53.567419 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1423/2847] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:58:53.829364 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:58:53.829838 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:58:53.829992 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:58:53.849742 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] MFA Rules not processed for user `7531d3cff80c4c889c7ca3bcaab3afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:58:53.850954 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:58:53.858136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1425/2848] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:03.560803 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=25 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:03.844220 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=42 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:12.959080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:12.969476 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ab64-a523-45d9-80aa-47bc55a8e13f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:12.973716 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:12.974415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:12.974698 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:12.974964 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:13.036661 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:13.038114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315ab37-8519-4006-9a2b-69fed6cd3342 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:13.047641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1424/2849] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:59:14.616532 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:14.629979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b8ca-5a99-43ca-93ce-cddd25a6d266 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:14.635563 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:14.636367 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:14.637624 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:14.637979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:14.639823 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:14.652433 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:14.654241 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:14.665708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1426/2850] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:59:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:59:15.407647 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2815-8c88-43f0-8df2-3758de88e39c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:15.408203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2815-8c88-43f0-8df2-3758de88e39c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:15.408203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2815-8c88-43f0-8df2-3758de88e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:15.472450 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c17a2815-8c88-43f0-8df2-3758de88e39c None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:59:15.473707 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c17a2815-8c88-43f0-8df2-3758de88e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:15.541114 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1425/2851] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Jul 29 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:15.592327 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:15.594309 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:15.685598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0430be2-a72e-4bd1-9e1a-0903eeb295bd service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:15.691512 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:15.692085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:15.692344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:15.692619 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:15.701894 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:15.703504 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:15.711938 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1427/2852] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:59:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:59:25.537839 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=74 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:25.708566 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=47 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:31.218671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:31.219160 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:31.219276 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:31.238294 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] MFA Rules not processed for user `eb10a008687543f496ff2a8ce3591bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:59:31.239496 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:31.247290 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1426/2853] 10.222.0.60 () {58 vars in 967 bytes} [Fri Jul 29 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:31.259213 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:31.270931 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21ccd2-0458-414d-a076-5cc14a43222a service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:31.275984 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050cd624409b4c269af8805835ec5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:31.276631 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:31.276965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:31.277237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:31.285494 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:31.287081 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:31.295243 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1428/2854] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Jul 29 11:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 11:59:31.700611 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:31.713066 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da8a54-92b7-44fa-8c0f-2d07d9158f6f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:31.718254 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:31.718864 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:31.719143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:31.719415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:31.721143 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:31.733542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:31.735266 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:31.745500 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1427/2855] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:59:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 11:59:33.206045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.218191 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54751-558f-4935-8a17-e97baf1fa723 service swift] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.222749 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.223385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.223667 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.223944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] PATH_INFO: `/v3/users/7531d3cff80c4c889c7ca3bcaab3afcf` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.225106 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7531d3cff80c4c889c7ca3bcaab3afcf)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.227061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.274397 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7531d3cff80c4c889c7ca3bcaab3afcf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.274959 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7531d3cff80c4c889c7ca3bcaab3afcf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.282040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7531d3cff80c4c889c7ca3bcaab3afcf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.282708 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7531d3cff80c4c889c7ca3bcaab3afcf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.294860 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-91297bf2-a4af-44cc-816a-21e3941a76c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7531d3cff80c4c889c7ca3bcaab3afcf'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.306519 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1429/2856] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:59:33 2022] DELETE /identity/v3/users/7531d3cff80c4c889c7ca3bcaab3afcf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:59:33.480606 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.491237 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2bf8-ef0c-476a-b472-ca67346a1065 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.550944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.551523 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.551804 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.552080 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] PATH_INFO: `/v3/projects/91aa577ac9bf45a49209c232a2237b81` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.553221 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91aa577ac9bf45a49209c232a2237b81)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.555171 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.600586 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91aa577ac9bf45a49209c232a2237b81', 'request_id': 'req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.607368 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91aa577ac9bf45a49209c232a2237b81', 'request_id': 'req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.612976 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91aa577ac9bf45a49209c232a2237b81', 'request_id': 'req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.624944 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] The token cache is being invalidate because project 91aa577ac9bf45a49209c232a2237b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 11:59:33.625230 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.625897 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4b1bfb6-21a2-454b-9b8b-bdd5f0a71f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 11:59:33.627431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1428/2857] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 11:59:33 2022] DELETE /identity/v3/projects/91aa577ac9bf45a49209c232a2237b81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:59:33.633171 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff38d-f408-4046-b88a-d1df943761df None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.633484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff38d-f408-4046-b88a-d1df943761df None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.633785 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff38d-f408-4046-b88a-d1df943761df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.654306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-436ff38d-f408-4046-b88a-d1df943761df None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:59:33.655491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-436ff38d-f408-4046-b88a-d1df943761df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:33.713998 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1430/2858] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:33.723081 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.723372 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.723655 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.743178 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:59:33.744378 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:33.752627 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1429/2859] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:33.756714 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ff38d-f408-4046-b88a-d1df943761df None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.767183 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ff38d-f408-4046-b88a-d1df943761df None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.771770 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.772381 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.772660 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.772933 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.773691 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 11:59:33.773996 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.775583 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.788580 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1431/2860] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 11:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 11:59:33.792876 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.802043 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dd732-d720-4545-8623-4ab850e6bc99 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.806638 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.807236 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.807512 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.807784 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.808462 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.810545 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.837626 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1430/2861] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 11:59:33 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 11:59:33.842522 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.852551 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432383-6dc2-4535-a51b-68285e20b9dd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.897211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:33.911425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.912033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.912310 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.912582 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.913251 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.915214 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.935366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1432/2862] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 11:59:33 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 11:59:33.939491 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.950734 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ca4b-7179-4ab8-bb6e-0b778f6979c5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.955319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.955955 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.956233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.956526 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.957214 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.959019 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:33.969541 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1431/2863] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 11:59:33.974023 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:33.984455 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a448-b188-47d1-bcab-0b4304b097d6 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:33.989036 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:33.989672 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:33.989953 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:33.990229 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:33.990912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:33.992497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695edd8-8ea2-4368-9a92-7d0915fe7519 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:34.003554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1433/2864] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 11:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 11:59:34.007599 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:34.018530 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b83-51ec-4cd8-8a1c-ba654e470002 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:34.023287 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:34.023941 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:34.024222 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:34.024497 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] PATH_INFO: `/v3/projects/4bb876ac2c4c4ed28d7fdfcc3e8df45b/users/794d28b5e34948ae94825f2babe17222/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:34.039319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb876ac2c4c4ed28d7fdfcc3e8df45b, user_id=794d28b5e34948ae94825f2babe17222, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:34.041980 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:34.055170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1432/2865] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 11:59:34 2022] PUT /identity/v3/projects/4bb876ac2c4c4ed28d7fdfcc3e8df45b/users/794d28b5e34948ae94825f2babe17222/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 11:59:34.065589 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:34.065882 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:34.066161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:34.094209 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] MFA Rules not processed for user `794d28b5e34948ae94825f2babe17222`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 11:59:34.095414 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:34.159293 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1434/2866] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 11:59:34.170914 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:34.172595 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 11:59:34.185958 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:34.256086 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c205-a1de-4c39-af57-60126689e9f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:34.259727 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bfc7686898b406bb89f9f0280308004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:34.260343 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:34.260624 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:34.260900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:34.270067 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:34.271486 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51bc9-15a8-4c80-92b9-b93ae646f51b service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 11:59:34.280362 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1433/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 11:59:44.156340 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:44.276192 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=32 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:59.927262 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 11:59:59.989875 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349f249-924e-4bec-bd22-e404e6d50c3b None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 11:59:59.995499 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 11:59:59.996141 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 11:59:59.996423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 11:59:59.996701 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] PATH_INFO: `/v3/users/794d28b5e34948ae94825f2babe17222` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 11:59:59.997898 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794d28b5e34948ae94825f2babe17222)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 11:59:59.999836 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.044353 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794d28b5e34948ae94825f2babe17222'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.044993 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794d28b5e34948ae94825f2babe17222'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.052317 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794d28b5e34948ae94825f2babe17222'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.053547 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794d28b5e34948ae94825f2babe17222'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.065595 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794d28b5e34948ae94825f2babe17222'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.077437 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1435/2868] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 11:59:59 2022] DELETE /identity/v3/users/794d28b5e34948ae94825f2babe17222 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:00:00.082014 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.082499 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.082597 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.101625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:00:00.102814 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:00.161092 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1434/2869] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:00:00.171423 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.172855 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:00.230616 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f49c5-95f0-4531-bdbe-ee6269ddd1f3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.234271 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.234885 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.235165 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.235438 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.245161 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.246650 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4c461-5dba-4be5-94ed-1048ad97dff7 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.255979 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1436/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:00:00.527929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.529348 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:00.544212 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f99d-5b0b-4775-a3d7-4f1b53236523 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.552634 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.554517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.554517 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.554868 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] PATH_INFO: `/v3/projects/4bb876ac2c4c4ed28d7fdfcc3e8df45b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.556576 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb876ac2c4c4ed28d7fdfcc3e8df45b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.557979 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.607772 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb876ac2c4c4ed28d7fdfcc3e8df45b', 'request_id': 'req-de2ca751-ac38-43f0-8583-747328166d40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.613872 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb876ac2c4c4ed28d7fdfcc3e8df45b', 'request_id': 'req-de2ca751-ac38-43f0-8583-747328166d40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.619531 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb876ac2c4c4ed28d7fdfcc3e8df45b', 'request_id': 'req-de2ca751-ac38-43f0-8583-747328166d40'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.631674 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] The token cache is being invalidate because project 4bb876ac2c4c4ed28d7fdfcc3e8df45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 12:00:00.631960 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.632593 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-de2ca751-ac38-43f0-8583-747328166d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:00.634152 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1435/2871] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 12:00:00 2022] DELETE /identity/v3/projects/4bb876ac2c4c4ed28d7fdfcc3e8df45b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:00:00.639394 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.639684 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.639965 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.667516 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:00:00.668732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:00.685758 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:00:00.730961 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1437/2872] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:00:00.738901 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1965-4630-4e06-b88c-242859132821 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.739206 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1965-4630-4e06-b88c-242859132821 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.739484 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1965-4630-4e06-b88c-242859132821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.761455 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-080d1965-4630-4e06-b88c-242859132821 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:00:00.762844 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-080d1965-4630-4e06-b88c-242859132821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:00.771542 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1436/2873] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:00:00.776468 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.786354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b0b89-44c4-405c-9ffb-6c8dd12355c3 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.790956 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.791567 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.791849 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.792125 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.792869 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 12:00:00.793258 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.794901 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.806316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1438/2874] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Jul 29 12:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 12:00:00.810818 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1965-4630-4e06-b88c-242859132821 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.820653 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1965-4630-4e06-b88c-242859132821 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.825392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.826033 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.826311 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.826580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.827246 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.829130 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.856815 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1437/2875] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Jul 29 12:00:00 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 12:00:00.861158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.871568 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c356b-8420-41d1-a3d8-2b4e1b293b22 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.930231 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.930909 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.931113 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.931386 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] PATH_INFO: `/v3/users` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.932051 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.934005 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.955912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1439/2876] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Jul 29 12:00:00 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 12:00:00.962209 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:00.972572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdb19-45aa-415f-9206-6bbdcf8ffbd8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:00.978994 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:00.979618 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:00.979905 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:00.980205 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:00.980929 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:00.982621 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:00.992684 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1438/2877] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 12:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 12:00:00.996586 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:01.007528 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d545-8792-48cc-b22c-5b026239e439 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:01.012192 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:01.012800 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:01.013079 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:01.013634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] PATH_INFO: `/v3/roles` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:01.014323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:01.015912 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638823-3749-4e88-9f7e-82e56a319508 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:01.026976 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1440/2878] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Jul 29 12:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 12:00:01.031108 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:01.041519 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4d76-54bc-4a7f-8cb1-dea67fa924cc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:01.046169 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:01.046828 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:01.047112 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:01.047387 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] PATH_INFO: `/v3/projects/41a92c7c5bb14ffcbb7b55b6713fc81f/users/7ef7e63aaab2428483853e39cc2205d1/roles/1bee8395f89b42498b722eee5ee49356` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:01.062449 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a92c7c5bb14ffcbb7b55b6713fc81f, user_id=7ef7e63aaab2428483853e39cc2205d1, role_id=1bee8395f89b42498b722eee5ee49356)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:01.065089 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:01.078228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1439/2879] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Jul 29 12:00:01 2022] PUT /identity/v3/projects/41a92c7c5bb14ffcbb7b55b6713fc81f/users/7ef7e63aaab2428483853e39cc2205d1/roles/1bee8395f89b42498b722eee5ee49356 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 12:00:01.088158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:01.088448 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:01.088721 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:01.117554 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] MFA Rules not processed for user `7ef7e63aaab2428483853e39cc2205d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:00:01.118775 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:01.182158 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1441/2880] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:00:01.193170 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:01.194377 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:01.216303 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:00:01.253806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0847-2921-4537-8b13-acf7b97b76ee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:01.257551 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939111fa56304aae981501d7a222b61f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:01.258177 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:01.258461 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:01.258738 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:01.267286 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:01.268706 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f6db-4ea9-4f01-8308-e85378254a14 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:01.277975 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1440/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:00:11.070972 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:11.090185 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:00:11.133704 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdde267-06e6-4729-a467-c66671bfda0f None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:11.138313 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:11.139211 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:11.139491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:11.139789 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] PATH_INFO: `/v3/users/7ef7e63aaab2428483853e39cc2205d1` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:11.140944 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef7e63aaab2428483853e39cc2205d1)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:11.142926 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:11.194366 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef7e63aaab2428483853e39cc2205d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.195045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef7e63aaab2428483853e39cc2205d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.202640 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef7e63aaab2428483853e39cc2205d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.203385 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef7e63aaab2428483853e39cc2205d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.216387 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef7e63aaab2428483853e39cc2205d1'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.230136 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1442/2882] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 12:00:11 2022] DELETE /identity/v3/users/7ef7e63aaab2428483853e39cc2205d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:00:11.234625 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:11.235101 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:11.235228 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:11.254291 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] MFA Rules not processed for user `0086f32849da40e39473b6be830b5501`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:00:11.255513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:11.319687 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1441/2883] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:00:11.329123 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:11.330594 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:11.386336 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a13c9-9589-40b6-96b2-0d02b01f63bd admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:11.390163 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:11.390769 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:11.391043 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:11.391312 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:11.400870 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:11.402323 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:11.411473 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1443/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:00:11.680473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:00:11.682052 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:00:11.694282 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584d88-04ba-421d-95f0-9226acb2e6d4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:00:11.698938 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:00:11.699681 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:00:11.699969 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:00:11.700261 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] PATH_INFO: `/v3/projects/41a92c7c5bb14ffcbb7b55b6713fc81f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:00:11.701404 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a92c7c5bb14ffcbb7b55b6713fc81f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:00:11.703342 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:00:11.749430 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a92c7c5bb14ffcbb7b55b6713fc81f', 'request_id': 'req-c8200706-737a-4565-adc0-69626d547553'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.755524 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a92c7c5bb14ffcbb7b55b6713fc81f', 'request_id': 'req-c8200706-737a-4565-adc0-69626d547553'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.761063 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a92c7c5bb14ffcbb7b55b6713fc81f', 'request_id': 'req-c8200706-737a-4565-adc0-69626d547553'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.774165 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] The token cache is being invalidate because project 41a92c7c5bb14ffcbb7b55b6713fc81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 12:00:11.774456 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.775099 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:00:11.776671 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1442/2885] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 12:00:11 2022] DELETE /identity/v3/projects/41a92c7c5bb14ffcbb7b55b6713fc81f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:00:21.407506 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:00:21.770473 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:21.210560 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:01:21.212069 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:21.223259 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55dcf-e6cc-4281-bfef-ede53760447b service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:01:21.271699 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:01:21.272306 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:01:21.272584 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:01:21.272854 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:01:21.274612 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:21.343635 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:01:21.345064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d552fab-d667-4b00-991f-62c09396eca4 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:01:21.356237 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1444/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:01:22.536999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:01:22.538443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:22.550762 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200706-737a-4565-adc0-69626d547553 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:01:22.554304 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:01:22.554904 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:01:22.555181 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:01:22.555451 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:01:22.557095 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:22.570088 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:01:22.571501 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:01:22.582923 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1443/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:01:24.862705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] REQUEST_METHOD: `POST` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:01:24.863182 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:01:24.863291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:01:24.882673 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.auth.core [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] MFA Rules not processed for user `5f9d278bd76c4ce0b90b8307b3c7d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:01:24.883877 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:24.938172 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1445/2888] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:01:25.250513 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:01:25.259215 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ecc6-ad8e-4f89-8e7c-15cba32c4b6b service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:01:25.262794 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:01:25.263395 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:01:25.263675 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:01:25.263950 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:01:25.265965 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:01:25.275415 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:01:25.276825 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52bf05-ca9c-451c-8618-7fd8017c4f38 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:01:25.285577 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1444/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:01:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:01:34.930977 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=79 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:35.281889 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:02:39.422632 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:02:39.424056 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:02:39.436832 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951944b4-d634-41e3-9904-2d2bc14f7901 None None] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:02:39.440628 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:02:39.441252 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:02:39.441573 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:02:39.441850 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:02:39.443705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:02:39.455732 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:02:39.457197 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:02:39.465324 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1446/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:02:49.461761 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:22.544330 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:03:22.544862 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:03:22.544982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:03:22.564233 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] MFA Rules not processed for user `5f9d278bd76c4ce0b90b8307b3c7d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 12:03:22.565465 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:03:22.572319 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1445/2891] 10.222.0.60 () {58 vars in 958 bytes} [Fri Jul 29 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 12:03:25.661373 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:03:25.664033 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:03:25.687325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476f160-f120-402a-87da-7fa88a0f4a7e service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:03:25.695539 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:03:25.696391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:03:25.696726 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:03:25.697344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:03:25.700446 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:03:25.716751 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:03:25.718498 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:03:25.730484 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1447/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:03:32.558853 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:35.725577 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=6 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:36.067809 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:03:36.081787 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966224ce-9a70-453b-9941-388e3d6940c0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:03:36.087283 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:03:36.087900 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:03:36.088183 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:03:36.088458 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:03:36.090203 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:03:36.100571 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:03:36.102188 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:03:36.111185 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1446/2893] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:03:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:03:46.106992 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:04:36.671940 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:04:36.673354 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:04:36.813291 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d37-7ad5-4175-ba32-c53d78626f6f service nova] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:04:36.818425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:04:36.819040 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:04:36.819320 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:04:36.819598 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:04:36.822061 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:04:36.833480 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:04:36.835050 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:04:36.845634 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1448/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:04:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:04:46.841178 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=63 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:19.307413 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:19.308957 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:19.372124 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500b79b-4ae7-426d-b311-d738bcc8a42f service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:19.379182 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2502e6309ca4a688de48416b09d16c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:19.379714 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:19.379999 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:19.380417 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:19.384264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:19.397806 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:19.399483 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:19.411431 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1447/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:05:29.406394 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=24 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:31.543659 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:31.562615 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a454f65-865f-431f-93c4-fdadd99db6e7 service placement] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:31.566332 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fa4877f580c4c708e7a6946b5f0d0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:31.566841 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:31.567120 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:31.567392 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:31.569135 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:31.654661 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:31.656085 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:31.675371 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1449/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:05:34.857869 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:34.859852 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:34.874920 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b612-a4e3-44f0-ba84-f8fdb6984478 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:34.883480 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:34.884227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:34.884580 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:34.884932 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:34.887115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:34.901918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:34.903668 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:34.916115 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1448/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:05:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 12:05:38.048460 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:38.050132 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:38.067325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2726-3434-4b10-9d7c-8c028729c805 service neutron] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:38.072179 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:38.072825 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:38.073766 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:38.074052 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] PATH_INFO: `/v3/users/5f9d278bd76c4ce0b90b8307b3c7d1f2` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:38.075218 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9d278bd76c4ce0b90b8307b3c7d1f2)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:38.077130 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:38.126044 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9d278bd76c4ce0b90b8307b3c7d1f2'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.126703 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9d278bd76c4ce0b90b8307b3c7d1f2'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.134469 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9d278bd76c4ce0b90b8307b3c7d1f2'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.135100 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9d278bd76c4ce0b90b8307b3c7d1f2'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.148119 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9d278bd76c4ce0b90b8307b3c7d1f2'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.160536 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1450/2898] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 12:05:38 2022] DELETE /identity/v3/users/5f9d278bd76c4ce0b90b8307b3c7d1f2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:05:38.355641 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:38.368918 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64655-ea31-4b7e-87a1-df6431b18acc service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:38.427314 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:38.427982 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:38.428970 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:38.429251 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] PATH_INFO: `/v3/projects/50680cfc97cf41c18d074cb84493cde7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:38.430441 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50680cfc97cf41c18d074cb84493cde7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:38.432345 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:38.479094 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50680cfc97cf41c18d074cb84493cde7', 'request_id': 'req-86fd3295-2423-4062-afb0-d84263be6d3a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.485105 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50680cfc97cf41c18d074cb84493cde7', 'request_id': 'req-86fd3295-2423-4062-afb0-d84263be6d3a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.491104 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50680cfc97cf41c18d074cb84493cde7', 'request_id': 'req-86fd3295-2423-4062-afb0-d84263be6d3a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.503146 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] The token cache is being invalidate because project 50680cfc97cf41c18d074cb84493cde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 12:05:38.503436 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.504046 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.505572 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1449/2899] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 12:05:38 2022] DELETE /identity/v3/projects/50680cfc97cf41c18d074cb84493cde7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:05:38.510316 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:38.511780 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:38.525064 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b7b2f-d3d8-45fd-9028-9441f37827d3 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:38.550047 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:38.587363 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:38.588045 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:38.588325 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:38.588603 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] PATH_INFO: `/v3/users/d988f8fe09504b2eb7caea58d9c0bc9a` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:38.589818 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d988f8fe09504b2eb7caea58d9c0bc9a)` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:38.591744 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:38.637759 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd988f8fe09504b2eb7caea58d9c0bc9a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.638344 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd988f8fe09504b2eb7caea58d9c0bc9a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.645764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd988f8fe09504b2eb7caea58d9c0bc9a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.646391 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd988f8fe09504b2eb7caea58d9c0bc9a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.658425 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.notifications [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd988f8fe09504b2eb7caea58d9c0bc9a'} {{(pid=86831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.670541 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1451/2900] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Jul 29 12:05:38 2022] DELETE /identity/v3/users/d988f8fe09504b2eb7caea58d9c0bc9a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:05:38.845443 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:05:38.847004 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:05:38.860628 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3295-2423-4062-afb0-d84263be6d3a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:05:38.919424 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0086f32849da40e39473b6be830b5501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c00e3cb2134915b18b1a5e5538e94a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:05:38.920001 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:05:38.920284 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:05:38.920564 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] PATH_INFO: `/v3/projects/1ecd2c66fb99437595a0631de1ea6357` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:05:38.921845 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecd2c66fb99437595a0631de1ea6357)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:05:38.923751 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:05:38.945119 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:38.971023 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecd2c66fb99437595a0631de1ea6357', 'request_id': 'req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.977773 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecd2c66fb99437595a0631de1ea6357', 'request_id': 'req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.983264 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecd2c66fb99437595a0631de1ea6357', 'request_id': 'req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.995937 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] The token cache is being invalidate because project 1ecd2c66fb99437595a0631de1ea6357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 12:05:38.996227 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.996849 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3aaaa3a9-68e9-432d-8977-0e4cb5d740a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 12:05:38.998392 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1450/2901] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Jul 29 12:05:38 2022] DELETE /identity/v3/projects/1ecd2c66fb99437595a0631de1ea6357 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 12:05:48.667000 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:48.992800 dv-cinder-837542-7-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:09:38.671374 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Authenticating user token {{(pid=86831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 12:09:38.672764 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:09:38.741604 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3d9f1-075f-42a4-8731-b043ae26e040 admin admin] Validating token access rules against request {{(pid=86831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 12:09:38.800497 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66151da3fa3a4bdb8816f74c7c434caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c0d67622e74258923a990b0f44ef02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 12:09:38.801118 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] REQUEST_METHOD: `GET` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 12:09:38.801400 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] SCRIPT_NAME: `/identity` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 12:09:38.801705 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 12:09:38.803491 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.fernet_utils [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 12:09:38.816034 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 12:09:38.817674 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44ecf3-9949-4780-8cf9-c577aaae502e service placement] RBAC: Authorization granted {{(pid=86831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 12:09:38.827843 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: [pid: 86831|app: 0|req: 1452/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Jul 29 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 12:09:48.823452 dv-cinder-837542-7-iscsi devstack@keystone.service[86831]: DEBUG dbcounter [-] [86831] Writing DB stats keystone:SELECT=58 {{(pid=86831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}